Sep 06 07:56:58 devstack cinder-volume[76339]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 06 07:56:58 devstack cinder-volume[76339]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 06 07:56:58 devstack cinder-volume[76339]: we strongly recommend against using it for new projects. Sep 06 07:56:58 devstack cinder-volume[76339]: If you are already using Eventlet, we recommend migrating to a different Sep 06 07:56:58 devstack cinder-volume[76339]: framework. For more detail see Sep 06 07:56:58 devstack cinder-volume[76339]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 06 07:56:58 devstack cinder-volume[76339]: import eventlet # noqa Sep 06 07:57:01 devstack cinder-volume[76339]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 06 07:57:01 devstack cinder-volume[76339]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 06 07:57:01 devstack cinder-volume[76339]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 06 07:57:02 devstack cinder-volume[76339]: INFO dbcounter [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Registered counter for database cinder Sep 06 07:57:02 devstack cinder-volume[76339]: DEBUG oslo_db.sqlalchemy.engines [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76339) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 07:57:02 devstack cinder-volume[76339]: DEBUG dbcounter [-] [76339] Writer thread running {{(pid=76339) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 06 07:57:02 devstack cinder-volume[76339]: INFO cinder.rpc [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 06 07:57:02 devstack cinder-volume[76339]: INFO cinder.rpc [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 06 07:57:02 devstack cinder-volume[76339]: DEBUG oslo_db.sqlalchemy.engines [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76339) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 07:57:02 devstack cinder-volume[76339]: INFO cinder.volume.manager [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Determined volume DB was empty at startup. Sep 06 07:57:02 devstack cinder-volume[76339]: DEBUG cinder.volume.manager [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76339) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 06 07:57:02 devstack cinder-volume[76339]: INFO cinder.volume.manager [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 06 07:57:02 devstack cinder-volume[76339]: WARNING stevedore.named [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 06 07:57:02 devstack cinder-volume[76339]: WARNING castellan.key_manager [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 06 07:57:02 devstack cinder-volume[76339]: WARNING cinder.keymgr.conf_key_mgr [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 06 07:57:02 devstack cinder-volume[76339]: DEBUG cinder.volume.drivers.lvm [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76339) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 06 07:57:02 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_concurrency.processutils [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] CMD "cinder-rtstool verify" returned: 0 in 0.453s {{(pid=76339) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_db.sqlalchemy.engines [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76339) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 07:57:03 devstack cinder-volume[76339]: INFO cinder.rpc [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 06 07:57:03 devstack cinder-volume[76339]: INFO cinder.rpc [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 06 07:57:03 devstack cinder-volume[76339]: WARNING stevedore.named [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 06 07:57:03 devstack cinder-volume[76339]: WARNING castellan.key_manager [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 06 07:57:03 devstack cinder-volume[76339]: INFO cinder.volume.manager [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_db.sqlalchemy.engines [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76339) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 07:57:03 devstack cinder-volume[76339]: INFO oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Starting 1 workers Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Started child 76502 {{(pid=76339) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Full set of CONF: {{(pid=76339) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] ******************************************************************************** {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Configuration options gathered from: {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] ================================================================================ {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] allow_availability_zone_fallback = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] allow_compression_on_image_upload = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] allowed_direct_url_schemes = [] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] api_rate_limit = True {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] auth_strategy = keystone {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] az_cache_duration = 3600 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_availability_zone = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_host = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_name = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_stats_polling_interval = 60 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76502]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backup_api_class = cinder.backup.api.API {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backup_name_template = backup-%s {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backup_use_same_host = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backup_use_temp_snapshot = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] chap_password = **** {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] chap_username = {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cinder_internal_tenant_project_id = 406b4cde277a4cb4a7e8d64a07b861fa {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cinder_internal_tenant_user_id = 19890573c1e241c493054678f30d5d26 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cloned_volume_same_az = True {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cluster = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] compression_format = gzip {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] compute_api_class = cinder.compute.nova.API {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] config_dir = [] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] config_source = [] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] control_exchange = openstack {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] debug = True {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] default_availability_zone = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] default_group_type = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] default_volume_type = lvmdriver-1 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] disk_geometry = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] driver_client_cert = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] driver_client_cert_key = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] driver_data_namespace = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] driver_ssl_cert_path = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] driver_ssl_cert_verify = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] driver_use_ssl = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] enable_force_upload = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] enable_new_services = True {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] enable_unsupported_driver = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] enabled_backends = ['lvmdriver-1'] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] enforce_multipath_for_image_xfer = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] filter_function = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] glance_api_insecure = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] glance_api_servers = ['http://192.168.122.190/image'] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] glance_api_ssl_compression = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] glance_ca_certificates_file = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] glance_catalog_info = image:glance:publicURL {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] glance_certfile = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] glance_keyfile = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] glance_num_retries = 3 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] glance_request_timeout = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] goodness_function = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] graceful_shutdown_timeout = 5 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] group_api_class = cinder.group.api.API {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] host = devstack {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] image_compress_on_upload = True {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] image_conversion_address_space_limit = 1 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] image_conversion_cpu_limit = 60 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] image_conversion_disable = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] image_upload_use_cinder_backend = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] image_upload_use_internal_tenant = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] image_volume_cache_enabled = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] image_volume_cache_max_count = 0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] image_volume_cache_max_size_gb = 0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] init_host_max_objects_retrieval = 0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] instance_format = [instance: %(uuid)s] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] iscsi_target_flags = {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] iscsi_write_cache = on {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] iser_helper = tgtadm {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] iser_ip_address = 192.168.122.190 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] iser_port = 3260 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] log_color = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] log_config_append = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] log_dir = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] log_file = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] log_options = True {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] log_rotate_interval = 1 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] log_rotate_interval_type = days {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] log_rotation_type = none {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] max_age = 0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] max_logfile_count = 30 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] max_logfile_size_mb = 200 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] max_over_subscription_ratio = 20.0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] message_reap_interval = 86400 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] message_ttl = 2592000 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] migration_create_volume_timeout_secs = 300 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] monkey_patch = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] monkey_patch_modules = [] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] my_ip = 192.168.122.190 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] no_snapshot_gb_quota = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] num_iser_scan_tries = 3 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] num_shell_tries = 3 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] num_volume_device_scan_tries = 3 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] nvmeof_conn_info_version = 1 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] nvmet_ns_id = 10 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] nvmet_port_id = 1 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] osapi_max_limit = 1000 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] osapi_volume_ext_list = [] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] osapi_volume_listen = 0.0.0.0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] osapi_volume_listen_port = 8776 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] osapi_volume_use_ssl = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] osapi_volume_workers = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] per_volume_size_limit = -1 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] periodic_fuzzy_delay = 60 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] periodic_interval = 60 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] project_id_regex = [0-9a-f\-]+ {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] public_endpoint = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] publish_errors = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] quota_backup_gigabytes = 1000 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] quota_backups = 10 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] quota_gigabytes = 1000 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] quota_groups = 10 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] quota_snapshots = 10 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] quota_volumes = 10 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] rate_limit_burst = 0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] rate_limit_except_level = CRITICAL {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] rate_limit_interval = 0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] reinit_driver_count = 3 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] replication_device = **** {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] report_discard_supported = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] report_interval = 120 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] reservation_clean_interval = 86400 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] reservation_expire = 86400 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] reserved_image_namespaces = [] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] reserved_percentage = 0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] rpc_response_timeout = 120 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] run_external_periodic_tasks = True {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] scst_target_driver = iscsi {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] scst_target_iqn_name = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] service_down_time = 720 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] shell_completion = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] snapshot_name_template = snapshot-%s {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] snapshot_same_host = True {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] split_loggers = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] state_path = /opt/stack/data/cinder {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] storage_availability_zone = nova {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76502]: INFO cinder.volume.manager [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] storage_protocol = iSCSI {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] syslog_log_facility = LOG_USER {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] target_helper = lioadm {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] target_ip_address = 192.168.122.190 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] target_port = 3260 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] target_protocol = iscsi {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] target_secondary_ip_addresses = [] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] trace_flags = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] transfer_api_class = cinder.transfer.api.API {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] transport_url = **** {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] until_refresh = 0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] use_chap_auth = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] use_default_quota_class = True {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] use_journal = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] use_json = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] use_multipath_for_image_xfer = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] use_stderr = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] use_syslog = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] verify_glance_signatures = enabled {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] volume_api_class = cinder.volume.api.API {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] volume_backend_name = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] volume_clear = zero {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] volume_clear_ionice = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] volume_clear_size = 0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] volume_copy_bps_limit = 0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] volume_dd_blocksize = 1M {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] volume_name_template = volume-%s {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] volume_service_inithost_offload = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] volume_usage_audit_period = month {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] zoning_mode = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_concurrency.disable_process_locking = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.auth_section = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.auth_type = password {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.auth_version = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.cache = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.certfile = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.delay_auth_decision = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.http_connect_timeout = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.include_service_catalog = True {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.insecure = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.interface = public {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.keyfile = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.memcache_password = **** {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.memcache_username = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.region_name = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.service_token_roles_required = True {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.service_type = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.token_cache_time = 300 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.190/identity {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.backend = dogpile.cache.null {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.backend_argument = **** {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.backend_expiration_time = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.config_prefix = cache.oslo {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.debug_cache_backend = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.enable_retry_client = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.enable_socket_keepalive = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.enabled = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.expiration_time = 600 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.052s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.hashclient_retry_attempts = 2 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.memcache_dead_retry = 300 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.memcache_pool_maxsize = 10 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.memcache_sasl_enabled = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.password = **** {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.proxies = [] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.redis_db = 0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.redis_sentinel_service_name = mymaster {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.redis_server = localhost:6379 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.retry_attempts = 2 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.retry_delay = 0.0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.socket_keepalive_count = 1 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.socket_keepalive_idle = 1 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.socket_keepalive_interval = 1 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.socket_timeout = 1.0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.tls_allowed_ciphers = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.tls_cafile = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.tls_certfile = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.tls_enabled = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.tls_keyfile = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cache.username = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] coordination.backend_url = **** {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] database.asyncio_connection = **** {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] database.asyncio_slave_connection = **** {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] database.backend = sqlalchemy {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] database.connection = **** {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] database.connection_debug = 0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] database.connection_parameters = {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] database.connection_recycle_time = 3600 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] database.connection_trace = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] database.db_inc_retry_interval = True {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] database.db_max_retries = 20 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] database.db_max_retry_interval = 10 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] database.db_retry_interval = 1 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] database.max_overflow = 50 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] database.max_pool_size = 5 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] database.max_retries = 10 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] database.mysql_wsrep_sync_wait = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] database.pool_timeout = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] database.retry_interval = 10 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] database.slave_connection = **** {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] database.sqlite_synchronous = True {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] database.synchronous_reader = True {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] database.use_db_reconnect = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_tracing.insecure = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] profiler.connection_string = messaging:// {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] profiler.enabled = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] profiler.es_doc_type = notification {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] profiler.es_scroll_size = 10000 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] profiler.es_scroll_time = 2m {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] profiler.filter_error_trace = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] profiler.hmac_keys = **** {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] profiler.sentinel_service_name = mymaster {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] profiler.socket_timeout = 0.1 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] profiler.trace_requests = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] profiler.trace_sqlalchemy = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] profiler_jaeger.process_tags = {} {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] profiler_jaeger.service_name_prefix = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] profiler_otlp.service_name_prefix = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_policy.enforce_new_defaults = True {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_policy.policy_default_rule = default {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_policy.policy_file = policy.yaml {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_policy.remote_timeout = 60.0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] privsep_osbrick.group = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] privsep_osbrick.helper_command = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] privsep_osbrick.user = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cinder_sys_admin.group = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cinder_sys_admin.helper_command = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] cinder_sys_admin.user = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] service_user.auth_section = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] service_user.auth_type = password {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] service_user.cafile = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] service_user.certfile = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] service_user.collect_timing = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] service_user.insecure = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] service_user.keyfile = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] service_user.send_service_user_token = True {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] service_user.split_loggers = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] service_user.timeout = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] service_user.tls_ciphers = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] service_user.tls_min_version = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] glance.auth_section = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] glance.auth_type = password {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] glance.certfile = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] glance.collect_timing = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] glance.insecure = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.053s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] glance.keyfile = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] glance.region_name = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] glance.split_loggers = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] glance.timeout = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] glance.tls_ciphers = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] glance.tls_min_version = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.backend_availability_zone = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.chap_password = **** {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.chap_username = {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.disk_geometry = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.driver_client_cert = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.driver_client_cert_key = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.driver_data_namespace = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.driver_use_ssl = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.enable_unsupported_driver = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.extra_capabilities = {} {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.filter_function = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.goodness_function = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.iscsi_target_flags = {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.iscsi_write_cache = on {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.iser_helper = tgtadm {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.iser_ip_address = 192.168.122.190 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.iser_port = 3260 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.lvm_mirrors = 0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.lvm_share_target = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.lvm_type = auto {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.num_shell_tries = 3 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.nvmet_port_id = 1 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.replication_device = **** {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.report_discard_supported = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.reserved_percentage = 0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.scst_target_driver = iscsi {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.scst_target_iqn_name = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.storage_protocol = iSCSI {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.target_helper = tgtadm {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.target_ip_address = 192.168.122.190 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.target_port = 3260 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.target_protocol = iscsi {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.trace_flags = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.unique_fqdn_network = True {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.use_chap_auth = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.volume_backend_name = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.volume_clear = zero {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.volume_clear_ionice = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.volume_clear_size = 0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.volume_group = cinder-volumes {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_reports.file_event_handler = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_reports.log_dir = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.backend_availability_zone = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.backend_host = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.chap_password = **** {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.chap_username = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.chiscsi_conf = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.disk_geometry = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.driver_client_cert = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.driver_data_namespace = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.driver_use_ssl = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.extra_capabilities = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.filter_function = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.goodness_function = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.iser_helper = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.iser_ip_address = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.iser_port = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.iser_target_prefix = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.lvm_conf_file = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.lvm_mirrors = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.lvm_share_target = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.lvm_type = auto {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.num_shell_tries = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.nvmet_port_id = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.replication_device = **** {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.report_discard_supported = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.reserved_percentage = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.scst_target_driver = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.storage_protocol = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.target_helper = lioadm {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.target_ip_address = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.target_port = 3260 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack sudo[76555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.target_protocol = iscsi {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.trace_flags = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.use_chap_auth = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack sudo[76555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.volume_clear = zero {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.volume_clear_size = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] lvmdriver-1.volumes_dir = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.ssl = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.ssl_version = {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_notifications.driver = [] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_notifications.retry = -1 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] oslo_messaging_notifications.transport_url = **** {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] key_manager.fixed_key = **** {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican.barbican_api_version = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican.barbican_endpoint = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican.barbican_endpoint_type = public {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican.barbican_region_name = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican.cafile = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican.certfile = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican.collect_timing = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican.insecure = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican.keyfile = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican.number_of_retries = 60 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican.retry_delay = 1 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican.send_service_user_token = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican.split_loggers = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican.timeout = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican.tls_ciphers = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican.tls_min_version = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican.verify_ssl = True {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican.verify_ssl_path = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican_service_user.auth_section = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican_service_user.auth_type = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican_service_user.cafile = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican_service_user.certfile = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican_service_user.collect_timing = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican_service_user.insecure = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican_service_user.keyfile = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican_service_user.split_loggers = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican_service_user.timeout = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican_service_user.tls_ciphers = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] barbican_service_user.tls_min_version = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] vault.approle_role_id = **** {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] vault.approle_secret_id = **** {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] vault.auth_method = approle {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] vault.auth_path = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] vault.kv_mountpoint = secret {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] vault.kv_path = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] vault.kv_version = 2 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] vault.namespace = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] vault.root_token_id = **** {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] vault.ssl_ca_crt_file = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] vault.timeout = 60.0 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] vault.token_file = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] vault.token_role = None {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] vault.use_ssl = False {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 07:57:03 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] ******************************************************************************** {{(pid=76339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 06 07:57:04 devstack sudo[76555]: pam_unix(sudo:session): session closed for user root Sep 06 07:57:04 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.325s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:04 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:04 devstack sudo[76691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 07:57:04 devstack sudo[76691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:57:04 devstack sudo[76691]: pam_unix(sudo:session): session closed for user root Sep 06 07:57:04 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.307s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:04 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 07:57:04 devstack cinder-volume[76502]: INFO cinder.brick.local_dev.lvm [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 06 07:57:04 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:04 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:04 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:04 devstack sudo[76784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 07:57:04 devstack sudo[76784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:57:04 devstack sudo[76784]: pam_unix(sudo:session): session closed for user root Sep 06 07:57:04 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:04 devstack cinder-volume[76502]: DEBUG cinder.brick.local_dev.lvm [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76502) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 06 07:57:04 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:04 devstack sudo[76874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 07:57:04 devstack sudo[76874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:57:05 devstack sudo[76874]: pam_unix(sudo:session): session closed for user root Sep 06 07:57:05 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.501s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:05 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:05 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:05 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:05 devstack sudo[77040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 07:57:05 devstack sudo[77040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:57:05 devstack sudo[77040]: pam_unix(sudo:session): session closed for user root Sep 06 07:57:05 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.311s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:05 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:05 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:05 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:05 devstack sudo[77115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 06 07:57:05 devstack sudo[77115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:57:05 devstack sudo[77115]: pam_unix(sudo:session): session closed for user root Sep 06 07:57:05 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.349s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:05 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:05 devstack sudo[77199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 07:57:05 devstack sudo[77199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:57:06 devstack sudo[77199]: pam_unix(sudo:session): session closed for user root Sep 06 07:57:06 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:06 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:06 devstack sudo[77204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 07:57:06 devstack sudo[77204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:57:06 devstack sudo[77204]: pam_unix(sudo:session): session closed for user root Sep 06 07:57:06 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.318s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:06 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:06 devstack sudo[77247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 07:57:06 devstack sudo[77247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:57:06 devstack sudo[77247]: pam_unix(sudo:session): session closed for user root Sep 06 07:57:06 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.303s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:06 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:06 devstack sudo[77301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 07:57:06 devstack sudo[77301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:57:07 devstack sudo[77301]: pam_unix(sudo:session): session closed for user root Sep 06 07:57:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:07 devstack sudo[77311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 07:57:07 devstack sudo[77311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:57:07 devstack sudo[77311]: pam_unix(sudo:session): session closed for user root Sep 06 07:57:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:07 devstack cinder-volume[76502]: INFO cinder.volume.drivers.lvm [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 06 07:57:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:07 devstack sudo[77315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 07:57:07 devstack sudo[77315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:57:07 devstack sudo[77315]: pam_unix(sudo:session): session closed for user root Sep 06 07:57:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:07 devstack cinder-volume[76502]: DEBUG cinder.volume.drivers.lvm [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Updating volume stats {{(pid=76502) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 06 07:57:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:07 devstack sudo[77318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 07:57:07 devstack sudo[77318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:57:07 devstack sudo[77318]: pam_unix(sudo:session): session closed for user root Sep 06 07:57:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:07 devstack sudo[77321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 07:57:07 devstack sudo[77321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:57:08 devstack sudo[77321]: pam_unix(sudo:session): session closed for user root Sep 06 07:57:08 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:08 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:08 devstack sudo[77324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 07:57:08 devstack sudo[77324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:57:08 devstack sudo[77324]: pam_unix(sudo:session): session closed for user root Sep 06 07:57:08 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:08 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:08 devstack sudo[77327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 07:57:08 devstack sudo[77327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:57:08 devstack sudo[77327]: pam_unix(sudo:session): session closed for user root Sep 06 07:57:08 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:08 devstack cinder-volume[76502]: INFO cinder.volume.driver [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Driver hasn't implemented _init_vendor_properties() Sep 06 07:57:08 devstack cinder-volume[76502]: DEBUG cinder.volume.driver [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76502) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 06 07:57:08 devstack cinder-volume[76502]: DEBUG oslo_db.sqlalchemy.engines [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76502) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 07:57:08 devstack cinder-volume[76502]: DEBUG dbcounter [-] [76502] Writer thread running {{(pid=76502) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 06 07:57:08 devstack cinder-volume[76502]: DEBUG cinder.db.api [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Building query based on filter {{(pid=76502) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 06 07:57:08 devstack cinder-volume[76502]: DEBUG cinder.image.image_utils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76502) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 06 07:57:08 devstack cinder-volume[76502]: INFO cinder.keymgr.migration [None req-3b627053-6afc-47f8-8bec-66e5b36194b6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 06 07:57:08 devstack cinder-volume[76502]: DEBUG cinder.volume.drivers.lvm [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Updating volume stats {{(pid=76502) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 06 07:57:08 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:08 devstack sudo[77332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 07:57:08 devstack sudo[77332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:57:09 devstack sudo[77332]: pam_unix(sudo:session): session closed for user root Sep 06 07:57:09 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:09 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:09 devstack sudo[77335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 07:57:09 devstack sudo[77335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:57:09 devstack sudo[77335]: pam_unix(sudo:session): session closed for user root Sep 06 07:57:09 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:09 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:09 devstack sudo[77339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 07:57:09 devstack sudo[77339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:57:09 devstack sudo[77339]: pam_unix(sudo:session): session closed for user root Sep 06 07:57:09 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:09 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:09 devstack sudo[77344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 07:57:09 devstack sudo[77344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:57:09 devstack sudo[77344]: pam_unix(sudo:session): session closed for user root Sep 06 07:57:09 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:09 devstack cinder-volume[76502]: DEBUG cinder.manager [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Notifying Schedulers of capabilities ... {{(pid=76502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 07:57:09 devstack cinder-volume[76502]: INFO cinder.volume.manager [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Driver initialization completed successfully. Sep 06 07:57:09 devstack cinder-volume[76502]: INFO cinder.manager [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Initiating service 2 cleanup Sep 06 07:57:09 devstack cinder-volume[76502]: INFO cinder.manager [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Service 2 cleanup completed. Sep 06 07:57:09 devstack cinder-volume[76502]: DEBUG cinder.service [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Creating RPC server for service cinder-volume {{(pid=76502) start /opt/stack/cinder/cinder/service.py:231}} Sep 06 07:57:09 devstack cinder-volume[76502]: DEBUG cinder.service [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76502) start /opt/stack/cinder/cinder/service.py:237}} Sep 06 07:57:10 devstack cinder-volume[76502]: INFO cinder.volume.manager [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 06 07:57:10 devstack cinder-volume[76502]: DEBUG cinder.volume.drivers.lvm [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Updating volume stats {{(pid=76502) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 06 07:57:10 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:10 devstack sudo[77347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 07:57:10 devstack sudo[77347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:57:10 devstack sudo[77347]: pam_unix(sudo:session): session closed for user root Sep 06 07:57:10 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:10 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:10 devstack sudo[77350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 07:57:10 devstack sudo[77350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:57:10 devstack sudo[77350]: pam_unix(sudo:session): session closed for user root Sep 06 07:57:10 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:10 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:10 devstack sudo[77356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 07:57:10 devstack sudo[77356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:57:10 devstack sudo[77356]: pam_unix(sudo:session): session closed for user root Sep 06 07:57:10 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:10 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:57:10 devstack sudo[77359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 07:57:10 devstack sudo[77359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:57:11 devstack sudo[77359]: pam_unix(sudo:session): session closed for user root Sep 06 07:57:11 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:57:11 devstack cinder-volume[76502]: INFO cinder.volume.manager [None req-d112851b-c9d3-460b-83c1-79d427eb2f0a None None] Driver post RPC initialization completed successfully. Sep 06 07:57:13 devstack cinder-volume[76339]: DEBUG dbcounter [-] [76339] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76339) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 07:57:21 devstack cinder-volume[76502]: DEBUG dbcounter [-] [76502] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76502) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 07:57:21 devstack cinder-volume[76502]: DEBUG dbcounter [-] [76502] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76502) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 07:57:56 devstack cinder-volume[76502]: DEBUG oslo_service.periodic_task [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] Running periodic task VolumeManager._thread_info {{(pid=76502) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 07:57:56 devstack cinder-volume[76502]: DEBUG cinder.volume.manager [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] thread count: 6 {{(pid=76502) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 07:57:56 devstack cinder-volume[76502]: DEBUG cinder.volume.manager [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] thread info: [<_MainThread(MainThread, started 126656779432064)>, , , , , ] {{(pid=76502) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 07:58:56 devstack cinder-volume[76502]: DEBUG oslo_service.periodic_task [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76502) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 07:58:56 devstack cinder-volume[76502]: DEBUG cinder.volume.drivers.lvm [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] Updating volume stats {{(pid=76502) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 06 07:58:56 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:58:56 devstack sudo[82579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 07:58:56 devstack sudo[82579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:58:56 devstack sudo[82579]: pam_unix(sudo:session): session closed for user root Sep 06 07:58:56 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:58:56 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:58:56 devstack sudo[82582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 07:58:56 devstack sudo[82582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:58:56 devstack sudo[82582]: pam_unix(sudo:session): session closed for user root Sep 06 07:58:56 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:58:56 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:58:56 devstack sudo[82586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 07:58:56 devstack sudo[82586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:58:57 devstack sudo[82586]: pam_unix(sudo:session): session closed for user root Sep 06 07:58:57 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:58:57 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:58:57 devstack sudo[82589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 07:58:57 devstack sudo[82589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:58:57 devstack sudo[82589]: pam_unix(sudo:session): session closed for user root Sep 06 07:58:57 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:58:57 devstack cinder-volume[76502]: DEBUG cinder.manager [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] Notifying Schedulers of capabilities ... {{(pid=76502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 07:58:57 devstack cinder-volume[76502]: DEBUG oslo_service.periodic_task [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] Running periodic task VolumeManager._thread_info {{(pid=76502) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 07:58:57 devstack cinder-volume[76502]: DEBUG cinder.volume.manager [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] thread count: 6 {{(pid=76502) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 07:58:57 devstack cinder-volume[76502]: DEBUG cinder.volume.manager [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] thread info: [<_MainThread(MainThread, started 126656779432064)>, , , , , ] {{(pid=76502) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 07:59:21 devstack cinder-volume[76502]: DEBUG dbcounter [-] [76502] Writing DB stats cinder:SELECT=1 {{(pid=76502) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 07:59:21 devstack cinder-volume[76502]: DEBUG dbcounter [-] [76502] Writing DB stats cinder:UPDATE=1 {{(pid=76502) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 07:59:56 devstack cinder-volume[76502]: DEBUG oslo_service.periodic_task [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76502) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 07:59:56 devstack cinder-volume[76502]: DEBUG cinder.volume.drivers.lvm [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] Updating volume stats {{(pid=76502) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 06 07:59:56 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:59:56 devstack sudo[84248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 07:59:56 devstack sudo[84248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:59:56 devstack sudo[84248]: pam_unix(sudo:session): session closed for user root Sep 06 07:59:56 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:59:56 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:59:56 devstack sudo[84257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 07:59:56 devstack sudo[84257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:59:56 devstack sudo[84257]: pam_unix(sudo:session): session closed for user root Sep 06 07:59:56 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:59:56 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:59:56 devstack sudo[84274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 07:59:56 devstack sudo[84274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:59:56 devstack sudo[84274]: pam_unix(sudo:session): session closed for user root Sep 06 07:59:56 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.240s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:59:56 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 07:59:57 devstack sudo[84283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 07:59:57 devstack sudo[84283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 07:59:57 devstack sudo[84283]: pam_unix(sudo:session): session closed for user root Sep 06 07:59:57 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 07:59:57 devstack cinder-volume[76502]: DEBUG cinder.manager [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] Notifying Schedulers of capabilities ... {{(pid=76502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 07:59:57 devstack cinder-volume[76502]: DEBUG oslo_service.periodic_task [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] Running periodic task VolumeManager._thread_info {{(pid=76502) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 07:59:57 devstack cinder-volume[76502]: DEBUG cinder.volume.manager [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] thread count: 6 {{(pid=76502) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 07:59:57 devstack cinder-volume[76502]: DEBUG cinder.volume.manager [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] thread info: [<_MainThread(MainThread, started 126656779432064)>, , , , , ] {{(pid=76502) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:00:56 devstack cinder-volume[76502]: DEBUG oslo_service.periodic_task [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76502) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:00:56 devstack cinder-volume[76502]: DEBUG cinder.volume.drivers.lvm [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] Updating volume stats {{(pid=76502) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 06 08:00:56 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:00:56 devstack sudo[85700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 08:00:56 devstack sudo[85700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:00:56 devstack sudo[85700]: pam_unix(sudo:session): session closed for user root Sep 06 08:00:56 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:00:56 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:00:56 devstack sudo[85704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 08:00:56 devstack sudo[85704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:00:56 devstack sudo[85704]: pam_unix(sudo:session): session closed for user root Sep 06 08:00:56 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:00:56 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:00:56 devstack sudo[85707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 08:00:56 devstack sudo[85707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:00:57 devstack sudo[85707]: pam_unix(sudo:session): session closed for user root Sep 06 08:00:57 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:00:57 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:00:57 devstack sudo[85714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 08:00:57 devstack sudo[85714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:00:57 devstack sudo[85714]: pam_unix(sudo:session): session closed for user root Sep 06 08:00:57 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:00:57 devstack cinder-volume[76502]: DEBUG cinder.manager [None req-34b8e9fd-e557-4a30-8a82-49bbcecc9f4b None None] Notifying Schedulers of capabilities ... {{(pid=76502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:01:21 devstack cinder-volume[76502]: DEBUG dbcounter [-] [76502] Writing DB stats cinder:SELECT=1 {{(pid=76502) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:01:21 devstack cinder-volume[76502]: DEBUG dbcounter [-] [76502] Writing DB stats cinder:UPDATE=1 {{(pid=76502) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:01:32 devstack cinder-volume[76339]: INFO oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Caught SIGTERM, stopping children Sep 06 08:01:32 devstack cinder-volume[76339]: DEBUG oslo_concurrency.lockutils [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Acquiring lock "singleton_lock" {{(pid=76339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 06 08:01:32 devstack cinder-volume[76339]: DEBUG oslo_concurrency.lockutils [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Acquired lock "singleton_lock" {{(pid=76339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 06 08:01:32 devstack cinder-volume[76339]: DEBUG oslo_concurrency.lockutils [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Releasing lock "singleton_lock" {{(pid=76339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 06 08:01:32 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Stop services. {{(pid=76339) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 06 08:01:32 devstack cinder-volume[76339]: DEBUG oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Killing children. {{(pid=76339) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 06 08:01:32 devstack cinder-volume[76339]: INFO oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Waiting on 1 children to exit Sep 06 08:01:35 devstack cinder-volume[76502]: DEBUG oslo_concurrency.lockutils [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Acquiring lock "singleton_lock" {{(pid=76502) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 06 08:01:35 devstack cinder-volume[76502]: DEBUG oslo_concurrency.lockutils [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Acquired lock "singleton_lock" {{(pid=76502) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 06 08:01:35 devstack cinder-volume[76502]: DEBUG oslo_concurrency.lockutils [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Releasing lock "singleton_lock" {{(pid=76502) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 06 08:01:35 devstack cinder-volume[76502]: WARNING amqp [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 06 08:01:35 devstack cinder-volume[76502]: WARNING amqp [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 06 08:01:35 devstack cinder-volume[76339]: INFO oslo_service.backend._eventlet.service [None req-7d91142d-cc52-45ba-aedb-4263654af12d None None] Child 76502 exited with status 0 Sep 06 08:01:35 devstack cinder-volume[86478]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 06 08:01:35 devstack cinder-volume[86478]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 06 08:01:35 devstack cinder-volume[86478]: we strongly recommend against using it for new projects. Sep 06 08:01:35 devstack cinder-volume[86478]: If you are already using Eventlet, we recommend migrating to a different Sep 06 08:01:35 devstack cinder-volume[86478]: framework. For more detail see Sep 06 08:01:35 devstack cinder-volume[86478]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 06 08:01:35 devstack cinder-volume[86478]: import eventlet # noqa Sep 06 08:01:37 devstack cinder-volume[86478]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 06 08:01:37 devstack cinder-volume[86478]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 06 08:01:37 devstack cinder-volume[86478]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 06 08:01:38 devstack cinder-volume[86478]: INFO dbcounter [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Registered counter for database cinder Sep 06 08:01:38 devstack cinder-volume[86478]: DEBUG oslo_db.sqlalchemy.engines [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86478) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 08:01:38 devstack cinder-volume[86478]: DEBUG dbcounter [-] [86478] Writer thread running {{(pid=86478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 06 08:01:38 devstack cinder-volume[86478]: INFO cinder.rpc [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 06 08:01:38 devstack cinder-volume[86478]: INFO cinder.rpc [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 06 08:01:38 devstack cinder-volume[86478]: DEBUG oslo_db.sqlalchemy.engines [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86478) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 08:01:38 devstack cinder-volume[86478]: INFO cinder.volume.manager [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Determined volume DB was empty at startup. Sep 06 08:01:38 devstack cinder-volume[86478]: DEBUG cinder.volume.manager [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86478) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 06 08:01:38 devstack cinder-volume[86478]: INFO cinder.volume.manager [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 06 08:01:38 devstack cinder-volume[86478]: WARNING stevedore.named [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 06 08:01:38 devstack cinder-volume[86478]: WARNING castellan.key_manager [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 06 08:01:38 devstack cinder-volume[86478]: WARNING cinder.keymgr.conf_key_mgr [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 06 08:01:38 devstack cinder-volume[86478]: INFO cinder.volume.manager [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 06 08:01:38 devstack cinder-volume[86478]: DEBUG oslo_db.sqlalchemy.engines [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86478) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 08:01:38 devstack cinder-volume[86478]: INFO oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Starting 1 workers Sep 06 08:01:38 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Started child 86730 {{(pid=86478) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 06 08:01:38 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Full set of CONF: {{(pid=86478) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 06 08:01:38 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] ******************************************************************************** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 06 08:01:38 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Configuration options gathered from: {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 06 08:01:38 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] ================================================================================ {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] allow_availability_zone_fallback = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] allow_compression_on_image_upload = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] allowed_direct_url_schemes = [] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] api_rate_limit = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] auth_strategy = keystone {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_availability_zone = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86730]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_host = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_name = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_stats_polling_interval = 60 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backup_api_class = cinder.backup.api.API {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backup_name_template = backup-%s {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backup_use_same_host = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backup_use_temp_snapshot = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] chap_password = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] chap_username = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cinder_internal_tenant_project_id = 406b4cde277a4cb4a7e8d64a07b861fa {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cinder_internal_tenant_user_id = 19890573c1e241c493054678f30d5d26 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cluster = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] compression_format = gzip {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] compute_api_class = cinder.compute.nova.API {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] config_dir = [] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] config_source = [] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] control_exchange = openstack {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] debug = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] default_availability_zone = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] default_group_type = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] default_volume_type = QuobyteHD {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] disk_geometry = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] driver_client_cert = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] driver_client_cert_key = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] driver_data_namespace = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] driver_ssl_cert_path = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] driver_ssl_cert_verify = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] driver_use_ssl = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] enable_new_services = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] enable_unsupported_driver = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] enabled_backends = ['QuobyteHD'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] enforce_multipath_for_image_xfer = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] filter_function = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] glance_api_insecure = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] glance_api_servers = ['http://192.168.122.190/image'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] glance_api_ssl_compression = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] glance_ca_certificates_file = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] glance_catalog_info = image:glance:publicURL {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] glance_certfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] glance_keyfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] glance_num_retries = 3 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] glance_request_timeout = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] goodness_function = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] graceful_shutdown_timeout = 5 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] group_api_class = cinder.group.api.API {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] host = devstack {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] image_compress_on_upload = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] image_conversion_address_space_limit = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] image_conversion_cpu_limit = 60 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] image_conversion_disable = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] image_upload_use_cinder_backend = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] image_upload_use_internal_tenant = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] image_volume_cache_enabled = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] image_volume_cache_max_count = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] image_volume_cache_max_size_gb = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] init_host_max_objects_retrieval = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] instance_format = [instance: %(uuid)s] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] iscsi_target_flags = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] iscsi_write_cache = on {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] iser_helper = tgtadm {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] iser_ip_address = 192.168.122.190 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86730]: INFO cinder.volume.manager [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Starting volume driver QuobyteDriver (1.2) Sep 06 08:01:39 devstack cinder-volume[86730]: DEBUG cinder.volume.drivers.remotefs [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86730) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] iser_port = 3260 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] log_color = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] log_config_append = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] log_dir = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] log_file = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] log_options = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] log_rotate_interval = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] log_rotate_interval_type = days {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] log_rotation_type = none {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] max_age = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] max_logfile_count = 30 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] max_logfile_size_mb = 200 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] max_over_subscription_ratio = 20.0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] message_reap_interval = 86400 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] message_ttl = 2592000 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] migration_create_volume_timeout_secs = 300 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] monkey_patch = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] monkey_patch_modules = [] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] my_ip = 192.168.122.190 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] no_snapshot_gb_quota = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] num_iser_scan_tries = 3 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] num_shell_tries = 3 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] num_volume_device_scan_tries = 3 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] nvmeof_conn_info_version = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] nvmet_ns_id = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] nvmet_port_id = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] osapi_max_limit = 1000 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] osapi_volume_ext_list = [] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] osapi_volume_listen = 0.0.0.0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] osapi_volume_listen_port = 8776 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] osapi_volume_use_ssl = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] osapi_volume_workers = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] per_volume_size_limit = -1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] periodic_fuzzy_delay = 60 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] periodic_interval = 60 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] project_id_regex = [0-9a-f\-]+ {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] public_endpoint = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] publish_errors = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] quota_backup_gigabytes = 1000 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] quota_backups = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] quota_gigabytes = 1000 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] quota_groups = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] quota_snapshots = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] quota_volumes = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] rate_limit_burst = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] rate_limit_except_level = CRITICAL {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] rate_limit_interval = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] reinit_driver_count = 3 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] replication_device = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] report_discard_supported = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] report_interval = 120 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] reservation_clean_interval = 86400 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] reservation_expire = 86400 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] reserved_image_namespaces = [] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] reserved_percentage = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] rpc_response_timeout = 120 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] run_external_periodic_tasks = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] scst_target_driver = iscsi {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] scst_target_iqn_name = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] service_down_time = 720 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] shell_completion = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] snapshot_name_template = snapshot-%s {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] split_loggers = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] state_path = /opt/stack/data/cinder {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] storage_availability_zone = nova {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] storage_protocol = iSCSI {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] syslog_log_facility = LOG_USER {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] target_helper = lioadm {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] target_ip_address = 192.168.122.190 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] target_port = 3260 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] target_protocol = iscsi {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] target_secondary_ip_addresses = [] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] trace_flags = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] transfer_api_class = cinder.transfer.api.API {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] transport_url = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] until_refresh = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] use_chap_auth = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] use_default_quota_class = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] use_journal = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] use_json = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] use_multipath_for_image_xfer = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] use_stderr = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] use_syslog = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] verify_glance_signatures = enabled {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] volume_api_class = cinder.volume.api.API {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] volume_backend_name = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] volume_clear = zero {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] volume_clear_ionice = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] volume_clear_size = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] volume_copy_bps_limit = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] volume_dd_blocksize = 1M {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] volume_name_template = volume-%s {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] volume_service_inithost_offload = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] volume_usage_audit_period = month {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] zoning_mode = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_concurrency.disable_process_locking = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.auth_section = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.auth_type = password {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.auth_version = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.cache = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.certfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.delay_auth_decision = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.http_connect_timeout = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.include_service_catalog = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.insecure = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.interface = public {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.keyfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.memcache_password = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.memcache_username = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86730]: DEBUG cinder.volume.drivers.quobyte [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86730) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Sep 06 08:01:39 devstack cinder-volume[86730]: WARNING cinder.volume.drivers.quobyte [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 06 08:01:39 devstack cinder-volume[86730]: WARNING cinder.volume.drivers.quobyte [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.region_name = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.service_token_roles_required = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.service_type = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.token_cache_time = 300 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.190/identity {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.backend = dogpile.cache.null {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86730]: DEBUG oslo_concurrency.processutils [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Running cmd (subprocess): mount.quobyte {{(pid=86730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.backend_argument = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.backend_expiration_time = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.config_prefix = cache.oslo {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.debug_cache_backend = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.enable_retry_client = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.enable_socket_keepalive = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.enabled = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.expiration_time = 600 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.hashclient_retry_attempts = 2 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.memcache_dead_retry = 300 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.memcache_pool_maxsize = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.memcache_sasl_enabled = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.password = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.proxies = [] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.redis_db = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.redis_sentinel_service_name = mymaster {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.redis_server = localhost:6379 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.retry_attempts = 2 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.retry_delay = 0.0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.socket_keepalive_count = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.socket_keepalive_idle = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.socket_keepalive_interval = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.socket_timeout = 1.0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.tls_allowed_ciphers = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.tls_cafile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.tls_certfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.tls_enabled = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.tls_keyfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cache.username = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] coordination.backend_url = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] database.asyncio_connection = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] database.asyncio_slave_connection = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] database.backend = sqlalchemy {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] database.connection = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] database.connection_debug = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] database.connection_parameters = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] database.connection_recycle_time = 3600 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] database.connection_trace = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] database.db_inc_retry_interval = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] database.db_max_retries = 20 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] database.db_max_retry_interval = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] database.db_retry_interval = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] database.max_overflow = 50 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] database.max_pool_size = 5 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] database.max_retries = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] database.mysql_wsrep_sync_wait = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] database.pool_timeout = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] database.retry_interval = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] database.slave_connection = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] database.sqlite_synchronous = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] database.synchronous_reader = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] database.use_db_reconnect = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_tracing.insecure = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] profiler.connection_string = messaging:// {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] profiler.enabled = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] profiler.es_doc_type = notification {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] profiler.es_scroll_size = 10000 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] profiler.es_scroll_time = 2m {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] profiler.filter_error_trace = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] profiler.hmac_keys = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] profiler.sentinel_service_name = mymaster {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] profiler.socket_timeout = 0.1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] profiler.trace_requests = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] profiler.trace_sqlalchemy = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] profiler_jaeger.process_tags = {} {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] profiler_jaeger.service_name_prefix = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] profiler_otlp.service_name_prefix = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_policy.enforce_new_defaults = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_policy.policy_default_rule = default {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_policy.policy_file = policy.yaml {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_policy.remote_timeout = 60.0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] privsep_osbrick.group = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] privsep_osbrick.helper_command = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] privsep_osbrick.user = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cinder_sys_admin.group = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cinder_sys_admin.helper_command = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] cinder_sys_admin.user = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] service_user.auth_section = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] service_user.auth_type = password {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] service_user.cafile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] service_user.certfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] service_user.collect_timing = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] service_user.insecure = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] service_user.keyfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack quobyte-client[86735]: Reading configuration file: /etc/quobyte/client.cfg Sep 06 08:01:39 devstack quobyte-client[86735]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 06 08:01:39 devstack cinder-volume[86730]: DEBUG oslo_concurrency.processutils [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] CMD "mount.quobyte" returned: 1 in 0.078s {{(pid=86730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] service_user.send_service_user_token = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86730]: DEBUG oslo_concurrency.lockutils [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86730) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] service_user.split_loggers = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86730]: DEBUG oslo_concurrency.lockutils [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86730) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:01:39 devstack cinder-volume[86730]: DEBUG cinder.volume.drivers.quobyte [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=86730) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] service_user.timeout = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] service_user.tls_ciphers = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] service_user.tls_min_version = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86730]: INFO cinder.volume.drivers.quobyte [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 ... Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] glance.auth_section = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] glance.auth_type = password {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86730]: DEBUG oslo_concurrency.processutils [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee -c /etc/quobyte/client-cinder.cfg {{(pid=86730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] glance.certfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] glance.collect_timing = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] glance.insecure = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] glance.keyfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] glance.region_name = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] glance.split_loggers = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] glance.timeout = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] glance.tls_ciphers = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] glance.tls_min_version = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.backend_availability_zone = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.chap_password = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.chap_username = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.disk_geometry = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.driver_client_cert = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.driver_client_cert_key = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.driver_data_namespace = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.driver_use_ssl = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.enable_unsupported_driver = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.extra_capabilities = {} {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.filter_function = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.goodness_function = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.iscsi_target_flags = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.iscsi_write_cache = on {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.iser_helper = tgtadm {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.iser_ip_address = 192.168.122.190 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.iser_port = 3260 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack sudo[86736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee -c /etc/quobyte/client-cinder.cfg Sep 06 08:01:39 devstack sudo[86736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.nas_host = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.nas_login = admin {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.nas_mount_options = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.nas_password = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.nas_private_key = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.nas_share_path = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.nas_ssh_port = 22 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.num_shell_tries = 3 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.nvmet_port_id = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.quobyte_client_cfg = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.quobyte_volume_url = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.replication_device = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.report_discard_supported = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.reserved_percentage = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.scst_target_driver = iscsi {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.scst_target_iqn_name = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.storage_protocol = iSCSI {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.target_helper = tgtadm {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.target_ip_address = 192.168.122.190 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.target_port = 3260 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.target_protocol = iscsi {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.trace_flags = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.unique_fqdn_network = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.use_chap_auth = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.volume_backend_name = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.volume_clear = zero {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.volume_clear_ionice = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.volume_clear_size = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_reports.file_event_handler = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_reports.log_dir = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.backend_availability_zone = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.backend_host = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.chap_password = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.chap_username = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.chiscsi_conf = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.disk_geometry = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.driver_client_cert = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.driver_client_cert_key = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.driver_data_namespace = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.driver_use_ssl = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.extra_capabilities = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.filter_function = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.goodness_function = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.iscsi_target_flags = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.iscsi_write_cache = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.iser_helper = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.iser_ip_address = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.iser_port = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.iser_target_prefix = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.nas_host = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.nas_login = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.nas_mount_options = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.nas_password = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.nas_private_key = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.nas_share_path = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.nas_ssh_port = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.num_shell_tries = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.nvmet_ns_id = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.nvmet_port_id = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.replication_device = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.report_discard_supported = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.reserved_percentage = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.scst_target_driver = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.storage_protocol = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.target_helper = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.target_ip_address = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.target_port = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.target_prefix = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.target_protocol = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.trace_flags = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.unique_fqdn_network = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.use_chap_auth = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.volume_clear = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.volume_clear_ionice = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.volume_clear_size = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] QuobyteHD.volumes_dir = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.ssl = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.ssl_version = {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_notifications.driver = [] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_notifications.retry = -1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] oslo_messaging_notifications.transport_url = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] key_manager.fixed_key = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican.barbican_api_version = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican.barbican_endpoint = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican.barbican_endpoint_type = public {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican.barbican_region_name = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican.cafile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican.certfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican.collect_timing = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican.insecure = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican.keyfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican.number_of_retries = 60 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican.retry_delay = 1 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican.send_service_user_token = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican.split_loggers = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican.timeout = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican.tls_ciphers = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican.tls_min_version = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican.verify_ssl = True {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican.verify_ssl_path = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican_service_user.auth_section = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican_service_user.auth_type = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican_service_user.cafile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican_service_user.certfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican_service_user.collect_timing = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican_service_user.insecure = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican_service_user.keyfile = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican_service_user.split_loggers = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican_service_user.timeout = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican_service_user.tls_ciphers = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] barbican_service_user.tls_min_version = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] vault.approle_role_id = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] vault.approle_secret_id = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] vault.auth_method = approle {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] vault.auth_path = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] vault.kv_mountpoint = secret {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] vault.kv_path = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] vault.kv_version = 2 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] vault.namespace = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] vault.root_token_id = **** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] vault.ssl_ca_crt_file = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] vault.timeout = 60.0 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] vault.token_file = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] vault.token_role = None {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] vault.use_ssl = False {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:39 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] ******************************************************************************** {{(pid=86478) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 06 08:01:39 devstack sudo[86736]: pam_unix(sudo:session): session closed for user root Sep 06 08:01:39 devstack cinder-volume[86730]: DEBUG oslo_concurrency.processutils [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.396s {{(pid=86730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:01:39 devstack cinder-volume[86730]: INFO cinder.volume.drivers.quobyte [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 succeeded Sep 06 08:01:39 devstack cinder-volume[86730]: DEBUG cinder.volume.drivers.quobyte [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=86730) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:01:39 devstack cinder-volume[86730]: DEBUG oslo_concurrency.lockutils [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.408s {{(pid=86730) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:01:39 devstack cinder-volume[86730]: DEBUG oslo_concurrency.processutils [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=86730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:01:39 devstack sudo[86805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:01:39 devstack sudo[86805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:01:39 devstack sudo[86805]: pam_unix(sudo:session): session closed for user root Sep 06 08:01:39 devstack cinder-volume[86730]: DEBUG oslo_concurrency.processutils [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.236s {{(pid=86730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:01:39 devstack cinder-volume[86730]: INFO cinder.volume.driver [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Driver hasn't implemented _init_vendor_properties() Sep 06 08:01:39 devstack cinder-volume[86730]: DEBUG cinder.volume.driver [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.665195465088, 'free_capacity_gb': 1773.665195465088, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86730) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 06 08:01:40 devstack cinder-volume[86730]: DEBUG oslo_db.sqlalchemy.engines [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86730) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 08:01:40 devstack cinder-volume[86730]: DEBUG dbcounter [-] [86730] Writer thread running {{(pid=86730) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 06 08:01:40 devstack cinder-volume[86730]: DEBUG cinder.db.api [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Building query based on filter {{(pid=86730) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 06 08:01:40 devstack cinder-volume[86730]: DEBUG cinder.image.image_utils [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86730) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 06 08:01:40 devstack cinder-volume[86730]: INFO cinder.keymgr.migration [None req-2c999fce-80a8-4a06-9011-c148dad18838 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 06 08:01:40 devstack cinder-volume[86730]: DEBUG oslo_concurrency.lockutils [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86730) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:01:40 devstack cinder-volume[86730]: DEBUG oslo_concurrency.lockutils [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86730) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:01:40 devstack cinder-volume[86730]: DEBUG cinder.volume.drivers.quobyte [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=86730) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:01:40 devstack cinder-volume[86730]: DEBUG cinder.volume.drivers.quobyte [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=86730) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:01:40 devstack cinder-volume[86730]: DEBUG oslo_concurrency.lockutils [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86730) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:01:40 devstack cinder-volume[86730]: DEBUG oslo_concurrency.processutils [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=86730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:01:40 devstack sudo[86808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:01:40 devstack sudo[86808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:01:40 devstack sudo[86808]: pam_unix(sudo:session): session closed for user root Sep 06 08:01:40 devstack cinder-volume[86730]: DEBUG oslo_concurrency.processutils [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.230s {{(pid=86730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:01:40 devstack cinder-volume[86730]: DEBUG cinder.manager [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Notifying Schedulers of capabilities ... {{(pid=86730) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:01:40 devstack cinder-volume[86730]: INFO cinder.volume.manager [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Driver initialization completed successfully. Sep 06 08:01:40 devstack cinder-volume[86730]: INFO cinder.manager [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Initiating service 3 cleanup Sep 06 08:01:40 devstack cinder-volume[86730]: INFO cinder.manager [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Service 3 cleanup completed. Sep 06 08:01:40 devstack cinder-volume[86730]: DEBUG cinder.service [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Creating RPC server for service cinder-volume {{(pid=86730) start /opt/stack/cinder/cinder/service.py:231}} Sep 06 08:01:40 devstack cinder-volume[86730]: DEBUG cinder.service [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86730) start /opt/stack/cinder/cinder/service.py:237}} Sep 06 08:01:40 devstack cinder-volume[86730]: INFO cinder.volume.manager [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Sep 06 08:01:40 devstack cinder-volume[86730]: DEBUG oslo_concurrency.lockutils [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86730) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:01:40 devstack cinder-volume[86730]: DEBUG oslo_concurrency.lockutils [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86730) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:01:40 devstack cinder-volume[86730]: DEBUG cinder.volume.drivers.quobyte [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=86730) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:01:40 devstack cinder-volume[86730]: DEBUG cinder.volume.drivers.quobyte [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=86730) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:01:40 devstack cinder-volume[86730]: DEBUG oslo_concurrency.lockutils [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86730) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:01:40 devstack cinder-volume[86730]: DEBUG oslo_concurrency.processutils [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=86730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:01:40 devstack sudo[86811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:01:40 devstack sudo[86811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:01:40 devstack sudo[86811]: pam_unix(sudo:session): session closed for user root Sep 06 08:01:40 devstack cinder-volume[86730]: DEBUG oslo_concurrency.processutils [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.333s {{(pid=86730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:01:40 devstack cinder-volume[86730]: INFO cinder.volume.manager [None req-78d23103-aa79-41cc-a130-49238bc5eead None None] Driver post RPC initialization completed successfully. Sep 06 08:01:45 devstack cinder-volume[86730]: DEBUG oslo_concurrency.lockutils [None req-47560b62-9c1c-45a9-a4e4-0091104b6db3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86730) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:01:45 devstack cinder-volume[86730]: DEBUG oslo_concurrency.lockutils [None req-47560b62-9c1c-45a9-a4e4-0091104b6db3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86730) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:01:45 devstack cinder-volume[86730]: DEBUG cinder.volume.drivers.quobyte [None req-47560b62-9c1c-45a9-a4e4-0091104b6db3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=86730) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:01:45 devstack cinder-volume[86730]: DEBUG cinder.volume.drivers.quobyte [None req-47560b62-9c1c-45a9-a4e4-0091104b6db3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=86730) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:01:45 devstack cinder-volume[86730]: DEBUG oslo_concurrency.lockutils [None req-47560b62-9c1c-45a9-a4e4-0091104b6db3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86730) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:01:45 devstack cinder-volume[86730]: DEBUG oslo_concurrency.processutils [None req-47560b62-9c1c-45a9-a4e4-0091104b6db3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=86730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:01:45 devstack sudo[86962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:01:45 devstack sudo[86962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:01:45 devstack sudo[86962]: pam_unix(sudo:session): session closed for user root Sep 06 08:01:45 devstack cinder-volume[86730]: DEBUG oslo_concurrency.processutils [None req-47560b62-9c1c-45a9-a4e4-0091104b6db3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.247s {{(pid=86730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:01:45 devstack cinder-volume[86730]: DEBUG cinder.manager [None req-47560b62-9c1c-45a9-a4e4-0091104b6db3 None None] Notifying Schedulers of capabilities ... {{(pid=86730) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:01:45 devstack cinder-volume[86478]: INFO oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Caught SIGTERM, stopping children Sep 06 08:01:45 devstack cinder-volume[86478]: DEBUG oslo_concurrency.lockutils [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Acquiring lock "singleton_lock" {{(pid=86478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 06 08:01:45 devstack cinder-volume[86478]: DEBUG oslo_concurrency.lockutils [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Acquired lock "singleton_lock" {{(pid=86478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 06 08:01:45 devstack cinder-volume[86478]: DEBUG oslo_concurrency.lockutils [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Releasing lock "singleton_lock" {{(pid=86478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 06 08:01:45 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Stop services. {{(pid=86478) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 06 08:01:45 devstack cinder-volume[86478]: DEBUG oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Killing children. {{(pid=86478) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 06 08:01:45 devstack cinder-volume[86478]: INFO oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Waiting on 1 children to exit Sep 06 08:01:48 devstack cinder-volume[86730]: DEBUG oslo_concurrency.lockutils [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Acquiring lock "singleton_lock" {{(pid=86730) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 06 08:01:48 devstack cinder-volume[86730]: DEBUG oslo_concurrency.lockutils [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Acquired lock "singleton_lock" {{(pid=86730) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 06 08:01:48 devstack cinder-volume[86730]: DEBUG oslo_concurrency.lockutils [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Releasing lock "singleton_lock" {{(pid=86730) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 06 08:01:48 devstack cinder-volume[86730]: WARNING amqp [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 06 08:01:48 devstack cinder-volume[86730]: WARNING amqp [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 06 08:01:48 devstack cinder-volume[86478]: INFO oslo_service.backend._eventlet.service [None req-8515f38c-d68a-43ab-a454-e4bc2323cbcc None None] Child 86730 exited with status 0 Sep 06 08:01:49 devstack cinder-volume[87019]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 06 08:01:49 devstack cinder-volume[87019]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 06 08:01:49 devstack cinder-volume[87019]: we strongly recommend against using it for new projects. Sep 06 08:01:49 devstack cinder-volume[87019]: If you are already using Eventlet, we recommend migrating to a different Sep 06 08:01:49 devstack cinder-volume[87019]: framework. For more detail see Sep 06 08:01:49 devstack cinder-volume[87019]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 06 08:01:49 devstack cinder-volume[87019]: import eventlet # noqa Sep 06 08:01:51 devstack cinder-volume[87019]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87019) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 06 08:01:51 devstack cinder-volume[87019]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87019) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 06 08:01:51 devstack cinder-volume[87019]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87019) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 06 08:01:52 devstack cinder-volume[87019]: INFO dbcounter [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] Registered counter for database cinder Sep 06 08:01:52 devstack cinder-volume[87019]: DEBUG oslo_db.sqlalchemy.engines [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87019) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG dbcounter [-] [87019] Writer thread running {{(pid=87019) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 06 08:01:53 devstack cinder-volume[87019]: INFO cinder.rpc [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 06 08:01:53 devstack cinder-volume[87019]: INFO cinder.rpc [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_db.sqlalchemy.engines [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87019) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 08:01:53 devstack cinder-volume[87019]: INFO cinder.volume.manager [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] Determined volume DB was empty at startup. Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG cinder.volume.manager [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87019) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 06 08:01:53 devstack cinder-volume[87019]: WARNING stevedore.named [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 06 08:01:53 devstack cinder-volume[87019]: WARNING castellan.key_manager [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 06 08:01:53 devstack cinder-volume[87019]: WARNING cinder.keymgr.conf_key_mgr [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 06 08:01:53 devstack cinder-volume[87019]: INFO cinder.volume.manager [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_db.sqlalchemy.engines [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87019) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 08:01:53 devstack cinder-volume[87019]: INFO oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] Starting 1 workers Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] Started child 87307 {{(pid=87019) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] Full set of CONF: {{(pid=87019) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] ******************************************************************************** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] Configuration options gathered from: {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] ================================================================================ {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 06 08:01:53 devstack cinder-volume[87307]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] allow_availability_zone_fallback = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] allow_compression_on_image_upload = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] allowed_direct_url_schemes = [] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] api_rate_limit = True {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] auth_strategy = keystone {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_availability_zone = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_host = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_name = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_stats_polling_interval = 60 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backup_api_class = cinder.backup.api.API {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backup_name_template = backup-%s {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backup_use_same_host = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backup_use_temp_snapshot = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] chap_password = **** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] chap_username = {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cinder_internal_tenant_project_id = 406b4cde277a4cb4a7e8d64a07b861fa {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cinder_internal_tenant_user_id = 19890573c1e241c493054678f30d5d26 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cluster = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] compression_format = gzip {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] compute_api_class = cinder.compute.nova.API {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] config_dir = [] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] config_source = [] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] control_exchange = openstack {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] debug = True {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] default_availability_zone = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] default_group_type = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] default_volume_type = QuobyteHD {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] disk_geometry = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] driver_client_cert = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] driver_client_cert_key = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] driver_data_namespace = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] driver_ssl_cert_path = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] driver_ssl_cert_verify = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] driver_use_ssl = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] enable_new_services = True {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] enable_unsupported_driver = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] enabled_backends = ['QuobyteHD'] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] enforce_multipath_for_image_xfer = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] filter_function = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] glance_api_insecure = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] glance_api_servers = ['http://192.168.122.190/image'] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] glance_api_ssl_compression = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] glance_ca_certificates_file = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] glance_catalog_info = image:glance:publicURL {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] glance_certfile = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] glance_keyfile = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] glance_num_retries = 3 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] glance_request_timeout = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] goodness_function = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] graceful_shutdown_timeout = 5 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] group_api_class = cinder.group.api.API {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] host = devstack {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] image_compress_on_upload = True {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] image_conversion_address_space_limit = 1 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] image_conversion_cpu_limit = 60 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] image_conversion_disable = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] image_upload_use_cinder_backend = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] image_upload_use_internal_tenant = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] image_volume_cache_enabled = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] image_volume_cache_max_count = 0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] image_volume_cache_max_size_gb = 0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] init_host_max_objects_retrieval = 0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] instance_format = [instance: %(uuid)s] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Starting volume driver QuobyteDriver (1.2) Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87307) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] iscsi_target_flags = {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] iscsi_write_cache = on {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] iser_helper = tgtadm {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] iser_ip_address = 192.168.122.190 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] iser_port = 3260 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] log_color = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] log_config_append = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] log_dir = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] log_file = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] log_options = True {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] log_rotate_interval = 1 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] log_rotate_interval_type = days {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] log_rotation_type = none {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] max_age = 0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] max_logfile_count = 30 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] max_logfile_size_mb = 200 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] max_over_subscription_ratio = 20.0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] message_reap_interval = 86400 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] message_ttl = 2592000 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] migration_create_volume_timeout_secs = 300 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] monkey_patch = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] monkey_patch_modules = [] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] my_ip = 192.168.122.190 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] no_snapshot_gb_quota = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] num_iser_scan_tries = 3 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] num_shell_tries = 3 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] num_volume_device_scan_tries = 3 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] nvmeof_conn_info_version = 1 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] nvmet_ns_id = 10 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] nvmet_port_id = 1 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] osapi_max_limit = 1000 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] osapi_volume_ext_list = [] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] osapi_volume_listen_port = 8776 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] osapi_volume_use_ssl = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] osapi_volume_workers = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] per_volume_size_limit = -1 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] periodic_fuzzy_delay = 60 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] periodic_interval = 60 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] public_endpoint = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] publish_errors = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] quota_backup_gigabytes = 1000 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] quota_backups = 10 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] quota_gigabytes = 1000 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] quota_groups = 10 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] quota_snapshots = 10 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] quota_volumes = 10 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] rate_limit_burst = 0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] rate_limit_except_level = CRITICAL {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] rate_limit_interval = 0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] reinit_driver_count = 3 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] replication_device = **** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] report_discard_supported = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] report_interval = 120 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] reservation_clean_interval = 86400 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] reservation_expire = 86400 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] reserved_image_namespaces = [] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] reserved_percentage = 0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] rpc_response_timeout = 120 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] run_external_periodic_tasks = True {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] scst_target_driver = iscsi {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] scst_target_iqn_name = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] service_down_time = 720 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] shell_completion = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] snapshot_name_template = snapshot-%s {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] split_loggers = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] state_path = /opt/stack/data/cinder {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] storage_availability_zone = nova {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] storage_protocol = iSCSI {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] syslog_log_facility = LOG_USER {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] target_helper = lioadm {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] target_ip_address = 192.168.122.190 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] target_port = 3260 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] target_protocol = iscsi {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] target_secondary_ip_addresses = [] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] trace_flags = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] transport_url = **** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] until_refresh = 0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] use_chap_auth = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] use_default_quota_class = True {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] use_journal = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] use_json = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] use_multipath_for_image_xfer = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] use_stderr = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] use_syslog = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] verify_glance_signatures = enabled {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] volume_api_class = cinder.volume.api.API {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] volume_backend_name = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] volume_clear = zero {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] volume_clear_ionice = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] volume_clear_size = 0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] volume_copy_bps_limit = 0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] volume_dd_blocksize = 1M {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] volume_name_template = volume-%s {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] volume_service_inithost_offload = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] volume_usage_audit_period = month {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] zoning_mode = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_concurrency.disable_process_locking = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.auth_section = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.auth_type = password {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.auth_version = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.cache = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.certfile = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.include_service_catalog = True {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.insecure = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.interface = public {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.keyfile = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.memcache_password = **** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.memcache_username = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.region_name = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.service_type = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.190/identity {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.backend = dogpile.cache.null {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.backend_argument = **** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.backend_expiration_time = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.config_prefix = cache.oslo {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.debug_cache_backend = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.enable_retry_client = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.enable_socket_keepalive = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.enabled = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.expiration_time = 600 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.hashclient_retry_attempts = 2 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.memcache_dead_retry = 300 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.memcache_pool_maxsize = 10 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.memcache_sasl_enabled = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.password = **** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.proxies = [] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.redis_db = 0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.redis_server = localhost:6379 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.retry_attempts = 2 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.retry_delay = 0.0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.socket_keepalive_count = 1 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.socket_keepalive_idle = 1 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.socket_keepalive_interval = 1 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.socket_timeout = 1.0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.tls_allowed_ciphers = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.tls_cafile = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.tls_certfile = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.tls_enabled = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.tls_keyfile = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cache.username = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] coordination.backend_url = **** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] database.asyncio_connection = **** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] database.asyncio_slave_connection = **** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] database.backend = sqlalchemy {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] database.connection = **** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] database.connection_debug = 0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] database.connection_parameters = {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87307) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] database.connection_recycle_time = 3600 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] database.connection_trace = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] database.db_inc_retry_interval = True {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] database.db_max_retries = 20 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] database.db_max_retry_interval = 10 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] database.db_retry_interval = 1 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] database.max_overflow = 50 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.quobyte [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] database.max_pool_size = 5 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] database.max_retries = 10 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] database.mysql_wsrep_sync_wait = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] database.pool_timeout = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.quobyte [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] database.retry_interval = 10 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] database.slave_connection = **** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] database.sqlite_synchronous = True {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] database.synchronous_reader = True {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] database.use_db_reconnect = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Running cmd (subprocess): mount.quobyte {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_tracing.insecure = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] profiler.connection_string = messaging:// {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] profiler.enabled = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] profiler.es_doc_type = notification {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] profiler.es_scroll_size = 10000 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] profiler.es_scroll_time = 2m {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] profiler.filter_error_trace = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] profiler.hmac_keys = **** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] profiler.sentinel_service_name = mymaster {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] profiler.socket_timeout = 0.1 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] profiler.trace_requests = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] profiler.trace_sqlalchemy = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] profiler_jaeger.process_tags = {} {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] profiler_jaeger.service_name_prefix = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] profiler_otlp.service_name_prefix = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_policy.enforce_new_defaults = True {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_policy.policy_default_rule = default {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_policy.policy_file = policy.yaml {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] privsep_osbrick.group = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] privsep_osbrick.helper_command = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] privsep_osbrick.user = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cinder_sys_admin.group = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cinder_sys_admin.helper_command = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] cinder_sys_admin.user = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] service_user.auth_section = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] service_user.auth_type = password {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] service_user.cafile = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] service_user.certfile = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] service_user.collect_timing = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] service_user.insecure = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] service_user.keyfile = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] service_user.send_service_user_token = True {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] service_user.split_loggers = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] service_user.timeout = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] service_user.tls_ciphers = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] service_user.tls_min_version = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] glance.auth_section = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] glance.auth_type = password {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] glance.certfile = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] glance.collect_timing = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] glance.insecure = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] glance.keyfile = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] glance.region_name = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] glance.split_loggers = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] glance.timeout = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] glance.tls_ciphers = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] glance.tls_min_version = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.backend_availability_zone = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.chap_password = **** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.chap_username = {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.disk_geometry = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.driver_client_cert = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.driver_client_cert_key = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.driver_data_namespace = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.driver_use_ssl = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.extra_capabilities = {} {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.filter_function = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.goodness_function = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.iscsi_target_flags = {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.iscsi_write_cache = on {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.iser_helper = tgtadm {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.iser_ip_address = 192.168.122.190 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.iser_port = 3260 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.nas_host = {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.nas_login = admin {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.nas_mount_options = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.nas_password = **** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.nas_private_key = {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.nas_share_path = {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.num_shell_tries = 3 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.quobyte_volume_url = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.replication_device = **** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.report_discard_supported = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.reserved_percentage = 0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.target_helper = tgtadm {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.target_ip_address = 192.168.122.190 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.target_port = 3260 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.target_protocol = iscsi {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.trace_flags = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.unique_fqdn_network = True {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.use_chap_auth = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.volume_backend_name = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.volume_clear = zero {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.volume_clear_ionice = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.volume_clear_size = 0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_reports.file_event_handler = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_reports.log_dir = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.backend_availability_zone = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.backend_host = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.chap_password = **** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.chap_username = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.chiscsi_conf = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.disk_geometry = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.driver_client_cert = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.driver_data_namespace = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.driver_use_ssl = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.extra_capabilities = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.filter_function = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.goodness_function = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.iser_helper = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.iser_ip_address = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.iser_port = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.iser_target_prefix = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.nas_host = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.nas_login = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.nas_mount_options = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.nas_password = **** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.nas_private_key = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.nas_share_path = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.nas_ssh_port = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.num_shell_tries = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.nvmet_port_id = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack quobyte-client[87308]: Reading configuration file: /etc/quobyte/client.cfg Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack quobyte-client[87308]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.replication_device = **** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.report_discard_supported = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.reserved_percentage = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.scst_target_driver = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] CMD "mount.quobyte" returned: 1 in 0.068s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.storage_protocol = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.target_helper = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.target_ip_address = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.target_port = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.target_prefix = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.target_protocol = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.trace_flags = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.use_chap_auth = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.volume_clear = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.volume_clear_size = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] QuobyteHD.volumes_dir = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.ssl = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_notifications.driver = [] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_notifications.retry = -1 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] key_manager.fixed_key = **** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican.barbican_api_version = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican.barbican_endpoint = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican.barbican_endpoint_type = public {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican.barbican_region_name = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican.cafile = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican.certfile = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican.collect_timing = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican.insecure = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican.keyfile = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican.number_of_retries = 60 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican.retry_delay = 1 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican.send_service_user_token = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican.split_loggers = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican.timeout = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican.tls_ciphers = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican.tls_min_version = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican.verify_ssl = True {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican.verify_ssl_path = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican_service_user.auth_section = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican_service_user.auth_type = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican_service_user.cafile = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican_service_user.certfile = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican_service_user.collect_timing = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican_service_user.insecure = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican_service_user.keyfile = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican_service_user.split_loggers = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican_service_user.timeout = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican_service_user.tls_ciphers = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] barbican_service_user.tls_min_version = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] vault.approle_role_id = **** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] vault.approle_secret_id = **** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] vault.auth_method = approle {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] vault.auth_path = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] vault.kv_mountpoint = secret {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack sudo[87309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] vault.kv_path = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] vault.kv_version = 2 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] vault.namespace = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] vault.root_token_id = **** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] vault.ssl_ca_crt_file = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] vault.timeout = 60.0 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] vault.token_file = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] vault.token_role = None {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] vault.use_ssl = False {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 08:01:53 devstack cinder-volume[87019]: DEBUG oslo_service.backend._eventlet.service [None req-9e2a8efa-3481-44e9-ab54-3a1d31787f83 None None] ******************************************************************************** {{(pid=87019) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 06 08:01:53 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root Sep 06 08:01:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.246s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:01:53 devstack cinder-volume[87307]: INFO cinder.volume.driver [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Driver hasn't implemented _init_vendor_properties() Sep 06 08:01:53 devstack cinder-volume[87307]: DEBUG cinder.volume.driver [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.665195465088, 'free_capacity_gb': 1773.665195465088, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87307) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 06 08:01:53 devstack cinder-volume[87307]: DEBUG oslo_db.sqlalchemy.engines [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87307) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 08:01:53 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writer thread running {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 06 08:01:53 devstack cinder-volume[87307]: DEBUG cinder.db.api [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Building query based on filter {{(pid=87307) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 06 08:01:54 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87307) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 06 08:01:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:01:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:01:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:01:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:01:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:01:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:01:54 devstack cinder-volume[87307]: INFO cinder.keymgr.migration [None req-230a7dcf-a861-43e1-99d6-d1685c116198 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 06 08:01:54 devstack sudo[87320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:01:54 devstack sudo[87320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:01:54 devstack sudo[87320]: pam_unix(sudo:session): session closed for user root Sep 06 08:01:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.230s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:01:54 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:01:54 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Driver initialization completed successfully. Sep 06 08:01:54 devstack cinder-volume[87307]: INFO cinder.manager [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Initiating service 3 cleanup Sep 06 08:01:54 devstack cinder-volume[87307]: INFO cinder.manager [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Service 3 cleanup completed. Sep 06 08:01:54 devstack cinder-volume[87307]: DEBUG cinder.service [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Creating RPC server for service cinder-volume {{(pid=87307) start /opt/stack/cinder/cinder/service.py:231}} Sep 06 08:01:54 devstack cinder-volume[87307]: DEBUG cinder.service [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87307) start /opt/stack/cinder/cinder/service.py:237}} Sep 06 08:01:54 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Sep 06 08:01:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:01:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:01:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:01:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:01:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:01:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:01:54 devstack sudo[87331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:01:54 devstack sudo[87331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:01:54 devstack sudo[87331]: pam_unix(sudo:session): session closed for user root Sep 06 08:01:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.248s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:01:54 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-0106ec2a-5e89-44f0-9d0a-12a1ddd9b4d5 None None] Driver post RPC initialization completed successfully. Sep 06 08:01:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager._thread_info {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:01:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread count: 6 {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 08:01:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread info: [<_MainThread(MainThread, started 139985167040640)>, , , , , ] {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:02:03 devstack cinder-volume[87019]: DEBUG dbcounter [-] [87019] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87019) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:02:04 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=2 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:02:04 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:02:53 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:02:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Flow 'volume_create_manager' (7772ca93-7487-4eba-ac53-0e15519f7c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:02:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72cdefbf-8557-4c40-9a49-74d8299a4b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:02:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72cdefbf-8557-4c40-9a49-74d8299a4b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-907453738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9c1b93-bd42-47db-b933-69bb03c621ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30bd577c19484b9199deb3eafcba6522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:02:54Z,use_quota=True,user_id='e62b5f0d5c254728b888f4a926b024fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:02:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (595ed865-a0be-407e-b2be-31286b86e7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:02:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (595ed865-a0be-407e-b2be-31286b86e7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:02:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a9dfa2-903d-41dd-9496-617c65db4e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:02:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a9dfa2-903d-41dd-9496-617c65db4e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df9c1b93-bd42-47db-b933-69bb03c621ae', 'volume_name': 'volume-df9c1b93-bd42-47db-b933-69bb03c621ae', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:02:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733d6464-1797-4735-95ac-961584a40626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:02:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733d6464-1797-4735-95ac-961584a40626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:02:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a77282-fb67-46c5-9b03-8e3776737c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:02:54 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Volume df9c1b93-bd42-47db-b933-69bb03c621ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df9c1b93-bd42-47db-b933-69bb03c621ae', 'volume_size': 1} Sep 06 08:02:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:02:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:02:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-907453738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9c1b93-bd42-47db-b933-69bb03c621ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30bd577c19484b9199deb3eafcba6522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:02:54Z,use_quota=True,user_id='e62b5f0d5c254728b888f4a926b024fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:02:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Creating volume df9c1b93-bd42-47db-b933-69bb03c621ae {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:02:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:02:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:02:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:02:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:02:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:02:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:02:54 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:02:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df9c1b93-bd42-47db-b933-69bb03c621ae 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:02:54 devstack sudo[87714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df9c1b93-bd42-47db-b933-69bb03c621ae 1073741824 Sep 06 08:02:54 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:02:54 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root Sep 06 08:02:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df9c1b93-bd42-47db-b933-69bb03c621ae 1073741824" returned: 0 in 0.643s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:02:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df9c1b93-bd42-47db-b933-69bb03c621ae {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:02:54 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df9c1b93-bd42-47db-b933-69bb03c621ae Sep 06 08:02:54 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:02:55 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Sep 06 08:02:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df9c1b93-bd42-47db-b933-69bb03c621ae" returned: 0 in 0.377s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:02:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:02:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:02:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a77282-fb67-46c5-9b03-8e3776737c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df9c1b93-bd42-47db-b933-69bb03c621ae', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:02:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4109ef29-4238-4d43-bc93-e86210b8fbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:02:55 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Volume volume-df9c1b93-bd42-47db-b933-69bb03c621ae (df9c1b93-bd42-47db-b933-69bb03c621ae): created successfully Sep 06 08:02:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4109ef29-4238-4d43-bc93-e86210b8fbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:02:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Flow 'volume_create_manager' (7772ca93-7487-4eba-ac53-0e15519f7c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:02:55 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-716d0bc5-363d-4b87-8207-c4c31d961615 tempest-TaggedAttachmentsTest-1054511945 None] Created volume successfully. Sep 06 08:02:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:02:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:02:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:02:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:02:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:02:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:02:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:02:59 devstack sudo[88049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:02:59 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:02:59 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root Sep 06 08:02:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.304s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:02:59 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:02:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager._thread_info {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:02:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread count: 6 {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 08:02:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread info: [<_MainThread(MainThread, started 139985167040640)>, , , , , ] {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:03:05 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:03:05 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:03:07 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:03:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Flow 'volume_create_manager' (4215fcc8-4012-482b-b476-1349927266c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:03:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f71250-bc6e-40e2-8e2a-69b6c1165dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:03:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f71250-bc6e-40e2-8e2a-69b6c1165dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-425579006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=493f5182-8dc0-4b7d-a315-10717edee543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72bdd15b9dab48c18bfaf566b6c45f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:03:07Z,use_quota=True,user_id='dd9d0fda1f1d4ecaa355194a825a3e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:03:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d834f801-6b6a-4396-9ab0-ea2e8ef4ef3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:03:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d834f801-6b6a-4396-9ab0-ea2e8ef4ef3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:03:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b246f4-931f-4224-91e2-46808dd2d5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:03:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b246f4-931f-4224-91e2-46808dd2d5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '493f5182-8dc0-4b7d-a315-10717edee543', 'volume_name': 'volume-493f5182-8dc0-4b7d-a315-10717edee543', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:03:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3a7a26-ed52-4763-914e-8e2d4a3ae9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:03:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3a7a26-ed52-4763-914e-8e2d4a3ae9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:03:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e6bd6b-9294-444c-8908-0f03b4e988a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:03:07 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Volume 493f5182-8dc0-4b7d-a315-10717edee543: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-493f5182-8dc0-4b7d-a315-10717edee543', 'volume_size': 1} Sep 06 08:03:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:03:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:03:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-425579006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=493f5182-8dc0-4b7d-a315-10717edee543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72bdd15b9dab48c18bfaf566b6c45f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:03:07Z,use_quota=True,user_id='dd9d0fda1f1d4ecaa355194a825a3e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:03:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Creating volume 493f5182-8dc0-4b7d-a315-10717edee543 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:03:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:03:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:03:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:03:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:03:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:03:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:03:07 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:03:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-493f5182-8dc0-4b7d-a315-10717edee543 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:03:07 devstack sudo[88169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-493f5182-8dc0-4b7d-a315-10717edee543 1073741824 Sep 06 08:03:07 devstack sudo[88169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:03:08 devstack sudo[88169]: pam_unix(sudo:session): session closed for user root Sep 06 08:03:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-493f5182-8dc0-4b7d-a315-10717edee543 1073741824" returned: 0 in 0.738s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:03:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-493f5182-8dc0-4b7d-a315-10717edee543 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:03:08 devstack sudo[88188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-493f5182-8dc0-4b7d-a315-10717edee543 Sep 06 08:03:08 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:03:08 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root Sep 06 08:03:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-493f5182-8dc0-4b7d-a315-10717edee543" returned: 0 in 0.487s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:03:08 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:03:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:03:09 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e6bd6b-9294-444c-8908-0f03b4e988a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-493f5182-8dc0-4b7d-a315-10717edee543', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:03:09 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c3020e-03eb-476c-89a7-7a9c416b9ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:03:09 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Volume volume-493f5182-8dc0-4b7d-a315-10717edee543 (493f5182-8dc0-4b7d-a315-10717edee543): created successfully Sep 06 08:03:09 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c3020e-03eb-476c-89a7-7a9c416b9ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:03:09 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Flow 'volume_create_manager' (4215fcc8-4012-482b-b476-1349927266c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:03:09 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-dddce70f-6078-4d20-94d0-41333df0105e tempest-DeleteServersTestJSON-212877152 None] Created volume successfully. Sep 06 08:03:14 devstack cinder-volume[87307]: WARNING py.warnings [req-ad4fd1bb-85b9-4689-b3f5-1cb5d56acb37 req-44c615ac-8d26-4807-9f9d-34ba9c63ed6c tempest-DeleteServersTestJSON-212877152 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 06 08:03:14 devstack cinder-volume[87307]: .first() Sep 06 08:03:14 devstack cinder-volume[87307]: Sep 06 08:03:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-ad4fd1bb-85b9-4689-b3f5-1cb5d56acb37 req-44c615ac-8d26-4807-9f9d-34ba9c63ed6c tempest-DeleteServersTestJSON-212877152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:03:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-ad4fd1bb-85b9-4689-b3f5-1cb5d56acb37 req-44c615ac-8d26-4807-9f9d-34ba9c63ed6c tempest-DeleteServersTestJSON-212877152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:03:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-ad4fd1bb-85b9-4689-b3f5-1cb5d56acb37 req-44c615ac-8d26-4807-9f9d-34ba9c63ed6c tempest-DeleteServersTestJSON-212877152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:03:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-ad4fd1bb-85b9-4689-b3f5-1cb5d56acb37 req-44c615ac-8d26-4807-9f9d-34ba9c63ed6c tempest-DeleteServersTestJSON-212877152 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0', 'name': 'volume-493f5182-8dc0-4b7d-a315-10717edee543', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68c9650b-307d-48ad-acc1-de69f1618627', 'enforce_multipath': True} {{(pid=87307) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 08:03:14 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-ad4fd1bb-85b9-4689-b3f5-1cb5d56acb37 req-44c615ac-8d26-4807-9f9d-34ba9c63ed6c tempest-DeleteServersTestJSON-212877152 None] attachment_update completed successfully. Sep 06 08:03:23 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-6298bef9-9d27-45d3-a7fc-5b8c1ec8fefa req-0034c884-bd17-4ac5-8a60-eb07df8b4cd4 tempest-DeleteServersTestJSON-212877152 None] Terminate volume connection completed successfully. Sep 06 08:03:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-6298bef9-9d27-45d3-a7fc-5b8c1ec8fefa req-0034c884-bd17-4ac5-8a60-eb07df8b4cd4 tempest-DeleteServersTestJSON-212877152 None] Deleting attachment 68c9650b-307d-48ad-acc1-de69f1618627. {{(pid=87307) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 08:03:25 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:03:25 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Flow 'volume_create_manager' (456404bf-4ee1-4dd8-b4e6-646785fd2eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:03:25 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9765ab-5e0b-4c99-8f33-87b3dec04728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:03:25 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9765ab-5e0b-4c99-8f33-87b3dec04728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2104799585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b41572db-9ac8-4a27-bfb8-10ed627d00bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609087adc82c4af7b85e1b347bc9ecda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:03:25Z,use_quota=True,user_id='d44ce82faab64797ba74ef9680e56f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:03:25 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1444f608-b1d8-4dea-aab4-13cdbd4d2542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:03:25 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1444f608-b1d8-4dea-aab4-13cdbd4d2542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:03:25 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a27ff3-4354-4a4f-b5fa-7b32fac18024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:03:25 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a27ff3-4354-4a4f-b5fa-7b32fac18024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b41572db-9ac8-4a27-bfb8-10ed627d00bb', 'volume_name': 'volume-b41572db-9ac8-4a27-bfb8-10ed627d00bb', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:03:25 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649a1d1f-0266-425c-af8f-f7182f6c7f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:03:25 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649a1d1f-0266-425c-af8f-f7182f6c7f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:03:25 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db857df6-d859-4bbe-8af2-004fac2a52f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:03:25 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Volume b41572db-9ac8-4a27-bfb8-10ed627d00bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b41572db-9ac8-4a27-bfb8-10ed627d00bb', 'volume_size': 1} Sep 06 08:03:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:03:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:03:25 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2104799585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b41572db-9ac8-4a27-bfb8-10ed627d00bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609087adc82c4af7b85e1b347bc9ecda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:03:25Z,use_quota=True,user_id='d44ce82faab64797ba74ef9680e56f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:03:25 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Creating volume b41572db-9ac8-4a27-bfb8-10ed627d00bb {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:03:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:03:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:03:25 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:03:25 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:03:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:03:25 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:03:25 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:03:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b41572db-9ac8-4a27-bfb8-10ed627d00bb 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:03:25 devstack sudo[88904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b41572db-9ac8-4a27-bfb8-10ed627d00bb 1073741824 Sep 06 08:03:25 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:03:26 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root Sep 06 08:03:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b41572db-9ac8-4a27-bfb8-10ed627d00bb 1073741824" returned: 0 in 0.663s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:03:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b41572db-9ac8-4a27-bfb8-10ed627d00bb {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:03:26 devstack sudo[88913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b41572db-9ac8-4a27-bfb8-10ed627d00bb Sep 06 08:03:26 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:03:26 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root Sep 06 08:03:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b41572db-9ac8-4a27-bfb8-10ed627d00bb" returned: 0 in 0.402s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:03:26 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:03:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:03:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db857df6-d859-4bbe-8af2-004fac2a52f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b41572db-9ac8-4a27-bfb8-10ed627d00bb', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:03:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0abb05c5-55cd-4ae7-8be4-e209ec3b29e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:03:26 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Volume volume-b41572db-9ac8-4a27-bfb8-10ed627d00bb (b41572db-9ac8-4a27-bfb8-10ed627d00bb): created successfully Sep 06 08:03:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0abb05c5-55cd-4ae7-8be4-e209ec3b29e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:03:27 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Flow 'volume_create_manager' (456404bf-4ee1-4dd8-b4e6-646785fd2eea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:03:27 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f67a6f06-8771-406e-a285-991f9243a93b tempest-VolumesAdminNegativeTest-162730584 None] Created volume successfully. Sep 06 08:03:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] Acquiring lock "cinder-493f5182-8dc0-4b7d-a315-10717edee543-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:03:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] Lock "cinder-493f5182-8dc0-4b7d-a315-10717edee543-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:03:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] Acquiring lock "cinder-quobyte-493f5182-8dc0-4b7d-a315-10717edee543" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:03:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] Lock "cinder-quobyte-493f5182-8dc0-4b7d-a315-10717edee543" acquired by "delete_volume" :: waited 0.029s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:03:27 devstack cinder-volume[87307]: INFO oslo.privsep.daemon [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpfufqwvjk/privsep.sock'] Sep 06 08:03:27 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpfufqwvjk/privsep.sock Sep 06 08:03:27 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:03:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bb14020a-4589-4a52-abd5-16631356c327 tempest-VolumesAdminNegativeTest-162730584 None] Acquiring lock "cinder-b41572db-9ac8-4a27-bfb8-10ed627d00bb-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:03:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bb14020a-4589-4a52-abd5-16631356c327 tempest-VolumesAdminNegativeTest-162730584 None] Lock "cinder-b41572db-9ac8-4a27-bfb8-10ed627d00bb-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:03:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bb14020a-4589-4a52-abd5-16631356c327 tempest-VolumesAdminNegativeTest-162730584 None] Acquiring lock "cinder-quobyte-b41572db-9ac8-4a27-bfb8-10ed627d00bb" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:03:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bb14020a-4589-4a52-abd5-16631356c327 tempest-VolumesAdminNegativeTest-162730584 None] Lock "cinder-quobyte-b41572db-9ac8-4a27-bfb8-10ed627d00bb" acquired by "delete_volume" :: waited 0.025s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:03:29 devstack cinder-volume[87307]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 06 08:03:29 devstack cinder-volume[87307]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 06 08:03:29 devstack cinder-volume[87307]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 06 08:03:29 devstack cinder-volume[87307]: WARNING oslo.privsep.daemon [-] privsep log: Sep 06 08:03:29 devstack cinder-volume[87307]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 06 08:03:29 devstack cinder-volume[87307]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 06 08:03:29 devstack cinder-volume[87307]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 06 08:03:29 devstack cinder-volume[87307]: WARNING oslo.privsep.daemon [-] privsep log: Sep 06 08:03:29 devstack cinder-volume[87307]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 06 08:03:29 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Sep 06 08:03:29 devstack cinder-volume[87307]: INFO oslo.privsep.daemon [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] Spawned new privsep daemon via rootwrap Sep 06 08:03:29 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] Accepted privsep connection to /tmp/tmpfufqwvjk/privsep.sock {{(pid=87307) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 06 08:03:29 devstack cinder-volume[87307]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 06 08:03:29 devstack cinder-volume[87307]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 06 08:03:29 devstack cinder-volume[87307]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 06 08:03:29 devstack cinder-volume[87307]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88921 Sep 06 08:03:29 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb6f366-8b27-4055-b237-18ba0e5dd2f1]: (2,) {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:03:29 devstack cinder-volume[87307]: WARNING oslo_privsep.priv_context [None req-bb14020a-4589-4a52-abd5-16631356c327 tempest-VolumesAdminNegativeTest-162730584 None] privsep daemon already running Sep 06 08:03:29 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8310d592-ad94-4380-9392-2a51db0f2cc7]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:03:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bb14020a-4589-4a52-abd5-16631356c327 tempest-VolumesAdminNegativeTest-162730584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b41572db-9ac8-4a27-bfb8-10ed627d00bb {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:03:29 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a27737-fef6-40ab-ac05-88b09d36f922]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:03:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-493f5182-8dc0-4b7d-a315-10717edee543 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:03:29 devstack sudo[88925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-493f5182-8dc0-4b7d-a315-10717edee543 Sep 06 08:03:29 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:03:29 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b41572db-9ac8-4a27-bfb8-10ed627d00bb Sep 06 08:03:29 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:03:29 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root Sep 06 08:03:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-493f5182-8dc0-4b7d-a315-10717edee543" returned: 0 in 0.487s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:03:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-493f5182-8dc0-4b7d-a315-10717edee543 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:03:29 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-493f5182-8dc0-4b7d-a315-10717edee543 Sep 06 08:03:29 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:03:30 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Sep 06 08:03:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bb14020a-4589-4a52-abd5-16631356c327 tempest-VolumesAdminNegativeTest-162730584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b41572db-9ac8-4a27-bfb8-10ed627d00bb" returned: 0 in 0.772s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:03:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bb14020a-4589-4a52-abd5-16631356c327 tempest-VolumesAdminNegativeTest-162730584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b41572db-9ac8-4a27-bfb8-10ed627d00bb {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:03:30 devstack sudo[88936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b41572db-9ac8-4a27-bfb8-10ed627d00bb Sep 06 08:03:30 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:03:30 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Sep 06 08:03:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-493f5182-8dc0-4b7d-a315-10717edee543" returned: 0 in 0.508s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:03:30 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] Lock "cinder-quobyte-493f5182-8dc0-4b7d-a315-10717edee543" released by "delete_volume" :: held 2.873s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:03:30 devstack cinder-volume[87307]: WARNING cinder.quota [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:03:30 devstack cinder-volume[87307]: WARNING cinder.quota [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:03:30 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root Sep 06 08:03:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bb14020a-4589-4a52-abd5-16631356c327 tempest-VolumesAdminNegativeTest-162730584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b41572db-9ac8-4a27-bfb8-10ed627d00bb" returned: 0 in 0.457s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:03:30 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] Created reservations ['bbc8108e-3566-4304-a698-eac63d96c4da', 'aa2190a5-9cdf-40bc-93c4-26914cab7787', 'b0bd1542-748e-45db-88b0-0d00198d1469', 'd2e0f856-d404-452e-82ca-a2b44c498dae'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:03:30 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bb14020a-4589-4a52-abd5-16631356c327 tempest-VolumesAdminNegativeTest-162730584 None] Lock "cinder-quobyte-b41572db-9ac8-4a27-bfb8-10ed627d00bb" released by "delete_volume" :: held 1.996s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:03:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:03:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:03:30 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:03:30 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:03:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:03:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:03:31 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-bb14020a-4589-4a52-abd5-16631356c327 tempest-VolumesAdminNegativeTest-162730584 None] Created reservations ['951fcc77-b913-4a7d-80cd-06fbaa399cf1', 'af1d7e93-f8c9-49bb-9c40-613f4ea8e852', '819976c0-f005-4235-901c-dee8a9bc152d', 'cffa4cc0-f9c5-4b21-b5a0-f3efa050e92f'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:03:31 devstack sudo[88941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:03:31 devstack sudo[88941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:03:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bb14020a-4589-4a52-abd5-16631356c327 tempest-VolumesAdminNegativeTest-162730584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:03:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bb14020a-4589-4a52-abd5-16631356c327 tempest-VolumesAdminNegativeTest-162730584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:03:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bb14020a-4589-4a52-abd5-16631356c327 tempest-VolumesAdminNegativeTest-162730584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:03:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bb14020a-4589-4a52-abd5-16631356c327 tempest-VolumesAdminNegativeTest-162730584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:03:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bb14020a-4589-4a52-abd5-16631356c327 tempest-VolumesAdminNegativeTest-162730584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:03:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bb14020a-4589-4a52-abd5-16631356c327 tempest-VolumesAdminNegativeTest-162730584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:03:31 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:03:31 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:03:31 devstack sudo[88941]: pam_unix(sudo:session): session closed for user root Sep 06 08:03:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.587s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:03:31 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:03:31 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] Deleted volume successfully. Sep 06 08:03:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ee516593-86af-40b9-918c-810d0fb7a674 tempest-DeleteServersTestJSON-212877152 None] Lock "cinder-493f5182-8dc0-4b7d-a315-10717edee543-delete_volume" released by "delete_volume" :: held 4.139s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:03:31 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Sep 06 08:03:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bb14020a-4589-4a52-abd5-16631356c327 tempest-VolumesAdminNegativeTest-162730584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.595s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:03:31 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-bb14020a-4589-4a52-abd5-16631356c327 tempest-VolumesAdminNegativeTest-162730584 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:03:31 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-bb14020a-4589-4a52-abd5-16631356c327 tempest-VolumesAdminNegativeTest-162730584 None] Deleted volume successfully. Sep 06 08:03:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bb14020a-4589-4a52-abd5-16631356c327 tempest-VolumesAdminNegativeTest-162730584 None] Lock "cinder-b41572db-9ac8-4a27-bfb8-10ed627d00bb-delete_volume" released by "delete_volume" :: held 3.377s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:03:41 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=23,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:03:41 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=20,cinder:UPDATE=22,cinder:DELETE=3,cinder:INSERT=5 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:03:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:03:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:03:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:03:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:03:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:03:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:03:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:03:59 devstack sudo[89120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:03:59 devstack sudo[89120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:03:59 devstack sudo[89120]: pam_unix(sudo:session): session closed for user root Sep 06 08:03:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.307s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:03:59 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:04:04 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:04:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-4458396f-3e8a-4f1a-95c7-607d975bd4bd req-4ab5d89b-2a6a-4418-a1d0-5e2ea71856f5 tempest-TaggedAttachmentsTest-1054511945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:04:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-4458396f-3e8a-4f1a-95c7-607d975bd4bd req-4ab5d89b-2a6a-4418-a1d0-5e2ea71856f5 tempest-TaggedAttachmentsTest-1054511945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:04:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-4458396f-3e8a-4f1a-95c7-607d975bd4bd req-4ab5d89b-2a6a-4418-a1d0-5e2ea71856f5 tempest-TaggedAttachmentsTest-1054511945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.080s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:04:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-4458396f-3e8a-4f1a-95c7-607d975bd4bd req-4ab5d89b-2a6a-4418-a1d0-5e2ea71856f5 tempest-TaggedAttachmentsTest-1054511945 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0', 'name': 'volume-df9c1b93-bd42-47db-b933-69bb03c621ae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4fae2e23-4863-40f5-9972-363eb3bebb89', 'enforce_multipath': True} {{(pid=87307) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 08:04:06 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-4458396f-3e8a-4f1a-95c7-607d975bd4bd req-4ab5d89b-2a6a-4418-a1d0-5e2ea71856f5 tempest-TaggedAttachmentsTest-1054511945 None] attachment_update completed successfully. Sep 06 08:04:13 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-397a5e55-59e5-4593-903e-12f8e2bdf9c4 req-104f4040-b365-4034-a640-730c5120e0eb tempest-TaggedAttachmentsTest-1054511945 None] Terminate volume connection completed successfully. Sep 06 08:04:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-397a5e55-59e5-4593-903e-12f8e2bdf9c4 req-104f4040-b365-4034-a640-730c5120e0eb tempest-TaggedAttachmentsTest-1054511945 None] Deleting attachment 4fae2e23-4863-40f5-9972-363eb3bebb89. {{(pid=87307) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 08:04:23 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:04:23 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:04:30 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:04:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Flow 'volume_create_manager' (2169a7cd-3e75-4735-a7f6-ecf185cdb373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:04:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040b036c-de35-433e-aef9-fdef6a275f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:04:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040b036c-de35-433e-aef9-fdef6a275f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-926960485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c380de61-c82a-427a-be2d-0c2f12e81b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7493cb7ea148d3abebc1872394e22f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:04:31Z,use_quota=True,user_id='841c4d9456884158b652d65a0faf5024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:04:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e5b831-0c2e-42ed-8ae8-bb82a8bacdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:04:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e5b831-0c2e-42ed-8ae8-bb82a8bacdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:04:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d5df59-7e3f-4f28-96ee-63a13c64e616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:04:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d5df59-7e3f-4f28-96ee-63a13c64e616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c380de61-c82a-427a-be2d-0c2f12e81b6f', 'volume_name': 'volume-c380de61-c82a-427a-be2d-0c2f12e81b6f', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:04:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e157759-f41f-4471-a94c-32c38ef5ce34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:04:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e157759-f41f-4471-a94c-32c38ef5ce34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:04:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19f3f2d-7072-43be-ac4a-0379aa4490e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:04:30 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Volume c380de61-c82a-427a-be2d-0c2f12e81b6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c380de61-c82a-427a-be2d-0c2f12e81b6f', 'volume_size': 1} Sep 06 08:04:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:04:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:04:30 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-926960485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c380de61-c82a-427a-be2d-0c2f12e81b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7493cb7ea148d3abebc1872394e22f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:04:31Z,use_quota=True,user_id='841c4d9456884158b652d65a0faf5024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:04:30 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Creating volume c380de61-c82a-427a-be2d-0c2f12e81b6f {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:04:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:04:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:04:30 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:04:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:04:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:04:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:04:31 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:04:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c380de61-c82a-427a-be2d-0c2f12e81b6f 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:04:31 devstack sudo[89976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c380de61-c82a-427a-be2d-0c2f12e81b6f 1073741824 Sep 06 08:04:31 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:04:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-25c47243-4720-4e58-b689-c30d058878c4 tempest-TaggedAttachmentsTest-1054511945 None] Acquiring lock "cinder-df9c1b93-bd42-47db-b933-69bb03c621ae-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:04:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-25c47243-4720-4e58-b689-c30d058878c4 tempest-TaggedAttachmentsTest-1054511945 None] Lock "cinder-df9c1b93-bd42-47db-b933-69bb03c621ae-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:04:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-25c47243-4720-4e58-b689-c30d058878c4 tempest-TaggedAttachmentsTest-1054511945 None] Acquiring lock "cinder-quobyte-df9c1b93-bd42-47db-b933-69bb03c621ae" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:04:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-25c47243-4720-4e58-b689-c30d058878c4 tempest-TaggedAttachmentsTest-1054511945 None] Lock "cinder-quobyte-df9c1b93-bd42-47db-b933-69bb03c621ae" acquired by "delete_volume" :: waited 0.029s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:04:31 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[afabb8ca-3235-4d00-ba92-395cbc01ae83]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:04:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-25c47243-4720-4e58-b689-c30d058878c4 tempest-TaggedAttachmentsTest-1054511945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df9c1b93-bd42-47db-b933-69bb03c621ae {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:04:31 devstack sudo[89981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df9c1b93-bd42-47db-b933-69bb03c621ae Sep 06 08:04:31 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:04:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c380de61-c82a-427a-be2d-0c2f12e81b6f 1073741824" returned: 0 in 0.904s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:04:31 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root Sep 06 08:04:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c380de61-c82a-427a-be2d-0c2f12e81b6f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:04:32 devstack sudo[89984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c380de61-c82a-427a-be2d-0c2f12e81b6f Sep 06 08:04:32 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:04:32 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root Sep 06 08:04:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-25c47243-4720-4e58-b689-c30d058878c4 tempest-TaggedAttachmentsTest-1054511945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df9c1b93-bd42-47db-b933-69bb03c621ae" returned: 0 in 0.719s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:04:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-25c47243-4720-4e58-b689-c30d058878c4 tempest-TaggedAttachmentsTest-1054511945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df9c1b93-bd42-47db-b933-69bb03c621ae {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:04:32 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root Sep 06 08:04:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c380de61-c82a-427a-be2d-0c2f12e81b6f" returned: 0 in 0.499s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:04:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:04:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:04:32 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df9c1b93-bd42-47db-b933-69bb03c621ae Sep 06 08:04:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19f3f2d-7072-43be-ac4a-0379aa4490e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c380de61-c82a-427a-be2d-0c2f12e81b6f', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:04:32 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:04:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92c56c4-146c-4f10-8ba1-f9896bd2a239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:04:32 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Volume volume-c380de61-c82a-427a-be2d-0c2f12e81b6f (c380de61-c82a-427a-be2d-0c2f12e81b6f): created successfully Sep 06 08:04:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92c56c4-146c-4f10-8ba1-f9896bd2a239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:04:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Flow 'volume_create_manager' (2169a7cd-3e75-4735-a7f6-ecf185cdb373) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:04:32 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-9011d1d4-238b-4448-acdf-d240fcdf1d23 tempest-ServerRescueNegativeTestJSON-1243484177 None] Created volume successfully. Sep 06 08:04:32 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Sep 06 08:04:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-25c47243-4720-4e58-b689-c30d058878c4 tempest-TaggedAttachmentsTest-1054511945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df9c1b93-bd42-47db-b933-69bb03c621ae" returned: 0 in 0.532s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:04:33 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-25c47243-4720-4e58-b689-c30d058878c4 tempest-TaggedAttachmentsTest-1054511945 None] Lock "cinder-quobyte-df9c1b93-bd42-47db-b933-69bb03c621ae" released by "delete_volume" :: held 1.330s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:04:33 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-25c47243-4720-4e58-b689-c30d058878c4 tempest-TaggedAttachmentsTest-1054511945 None] Created reservations ['12fadc34-65f1-45c6-b632-005dfa383bdc', '610f7807-8c70-4ebf-8bdb-5b1cc50946cc', 'd91f4971-3467-471f-98ec-4885473c2949', 'c4b5c9d7-4492-4f69-8fe2-04af765c4964'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:04:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-25c47243-4720-4e58-b689-c30d058878c4 tempest-TaggedAttachmentsTest-1054511945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:04:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-25c47243-4720-4e58-b689-c30d058878c4 tempest-TaggedAttachmentsTest-1054511945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:04:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-25c47243-4720-4e58-b689-c30d058878c4 tempest-TaggedAttachmentsTest-1054511945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:04:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-25c47243-4720-4e58-b689-c30d058878c4 tempest-TaggedAttachmentsTest-1054511945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:04:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-25c47243-4720-4e58-b689-c30d058878c4 tempest-TaggedAttachmentsTest-1054511945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:04:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-25c47243-4720-4e58-b689-c30d058878c4 tempest-TaggedAttachmentsTest-1054511945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:04:33 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:04:33 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:04:33 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Sep 06 08:04:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-25c47243-4720-4e58-b689-c30d058878c4 tempest-TaggedAttachmentsTest-1054511945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.425s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:04:33 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-25c47243-4720-4e58-b689-c30d058878c4 tempest-TaggedAttachmentsTest-1054511945 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:04:33 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-25c47243-4720-4e58-b689-c30d058878c4 tempest-TaggedAttachmentsTest-1054511945 None] Deleted volume successfully. Sep 06 08:04:33 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-25c47243-4720-4e58-b689-c30d058878c4 tempest-TaggedAttachmentsTest-1054511945 None] Lock "cinder-df9c1b93-bd42-47db-b933-69bb03c621ae-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:04:35 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:04:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Flow 'volume_create_manager' (bb3142a5-7fe9-4b23-98b6-47c5e21e8044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:04:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a776b4-5d69-48a9-8b06-f3b971dc2370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:04:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a776b4-5d69-48a9-8b06-f3b971dc2370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2025309810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626564de-d544-4f50-9e32-4d9bb2410af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124ed88d574eee89b8c6791075f8ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:04:36Z,use_quota=True,user_id='cdafa67bf4be417c9367892fc0a0a48c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:04:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e684c055-6c06-4f81-907a-b35279eb1156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:04:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e684c055-6c06-4f81-907a-b35279eb1156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:04:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5b6fbf-d3cf-4621-815b-553d29387fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:04:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5b6fbf-d3cf-4621-815b-553d29387fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '626564de-d544-4f50-9e32-4d9bb2410af0', 'volume_name': 'volume-626564de-d544-4f50-9e32-4d9bb2410af0', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:04:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a2c5a5-7fcb-4148-9cb0-2393f99ceef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:04:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a2c5a5-7fcb-4148-9cb0-2393f99ceef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:04:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc192a6-8a5c-48a0-8d50-9222c552e125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:04:35 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Volume 626564de-d544-4f50-9e32-4d9bb2410af0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-626564de-d544-4f50-9e32-4d9bb2410af0', 'volume_size': 1} Sep 06 08:04:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:04:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:04:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2025309810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626564de-d544-4f50-9e32-4d9bb2410af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f124ed88d574eee89b8c6791075f8ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:04:36Z,use_quota=True,user_id='cdafa67bf4be417c9367892fc0a0a48c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:04:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Creating volume 626564de-d544-4f50-9e32-4d9bb2410af0 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:04:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:04:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:04:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:04:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:04:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:04:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:04:35 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:04:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-626564de-d544-4f50-9e32-4d9bb2410af0 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:04:35 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-626564de-d544-4f50-9e32-4d9bb2410af0 1073741824 Sep 06 08:04:35 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:04:36 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Sep 06 08:04:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-626564de-d544-4f50-9e32-4d9bb2410af0 1073741824" returned: 0 in 0.701s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:04:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-626564de-d544-4f50-9e32-4d9bb2410af0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:04:36 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-626564de-d544-4f50-9e32-4d9bb2410af0 Sep 06 08:04:36 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:04:37 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Sep 06 08:04:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-626564de-d544-4f50-9e32-4d9bb2410af0" returned: 0 in 0.455s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:04:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:04:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:04:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc192a6-8a5c-48a0-8d50-9222c552e125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-626564de-d544-4f50-9e32-4d9bb2410af0', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:04:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd27639-a5c8-4769-8ef7-f906293926e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:04:37 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Volume volume-626564de-d544-4f50-9e32-4d9bb2410af0 (626564de-d544-4f50-9e32-4d9bb2410af0): created successfully Sep 06 08:04:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd27639-a5c8-4769-8ef7-f906293926e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:04:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Flow 'volume_create_manager' (bb3142a5-7fe9-4b23-98b6-47c5e21e8044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:04:37 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-33e95d15-c9fe-45c6-801a-c9c33d5b240d tempest-AttachVolumeShelveTestJSON-1247689438 None] Created volume successfully. Sep 06 08:04:47 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:UPDATE=14,cinder:SELECT=8,cinder:INSERT=4 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:04:47 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=10,cinder:UPDATE=14,cinder:INSERT=2,cinder:DELETE=3 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:04:49 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-517b90ef-8599-4d99-a405-806bcb098ac3 tempest-ServerRescueNegativeTestJSON-1243484177 None] Acquiring lock "cinder-c380de61-c82a-427a-be2d-0c2f12e81b6f-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:04:49 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-517b90ef-8599-4d99-a405-806bcb098ac3 tempest-ServerRescueNegativeTestJSON-1243484177 None] Lock "cinder-c380de61-c82a-427a-be2d-0c2f12e81b6f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:04:49 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-517b90ef-8599-4d99-a405-806bcb098ac3 tempest-ServerRescueNegativeTestJSON-1243484177 None] Acquiring lock "cinder-quobyte-c380de61-c82a-427a-be2d-0c2f12e81b6f" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:04:49 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-517b90ef-8599-4d99-a405-806bcb098ac3 tempest-ServerRescueNegativeTestJSON-1243484177 None] Lock "cinder-quobyte-c380de61-c82a-427a-be2d-0c2f12e81b6f" acquired by "delete_volume" :: waited 0.033s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:04:49 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f29c344-d4db-423d-93f0-41a502cfb046]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:04:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-517b90ef-8599-4d99-a405-806bcb098ac3 tempest-ServerRescueNegativeTestJSON-1243484177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c380de61-c82a-427a-be2d-0c2f12e81b6f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:04:49 devstack sudo[90256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c380de61-c82a-427a-be2d-0c2f12e81b6f Sep 06 08:04:49 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:04:50 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root Sep 06 08:04:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-517b90ef-8599-4d99-a405-806bcb098ac3 tempest-ServerRescueNegativeTestJSON-1243484177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c380de61-c82a-427a-be2d-0c2f12e81b6f" returned: 0 in 0.850s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:04:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-517b90ef-8599-4d99-a405-806bcb098ac3 tempest-ServerRescueNegativeTestJSON-1243484177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c380de61-c82a-427a-be2d-0c2f12e81b6f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:04:50 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c380de61-c82a-427a-be2d-0c2f12e81b6f Sep 06 08:04:50 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:04:51 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Sep 06 08:04:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-517b90ef-8599-4d99-a405-806bcb098ac3 tempest-ServerRescueNegativeTestJSON-1243484177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c380de61-c82a-427a-be2d-0c2f12e81b6f" returned: 0 in 0.548s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:04:51 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-517b90ef-8599-4d99-a405-806bcb098ac3 tempest-ServerRescueNegativeTestJSON-1243484177 None] Lock "cinder-quobyte-c380de61-c82a-427a-be2d-0c2f12e81b6f" released by "delete_volume" :: held 1.513s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:04:51 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-517b90ef-8599-4d99-a405-806bcb098ac3 tempest-ServerRescueNegativeTestJSON-1243484177 None] Created reservations ['396489dc-979d-45f3-a70c-7163a4152f7e', '81d1f625-11b4-451d-b9e5-8b1004f3de2d', '62914f33-71b3-4796-b2bb-d7cdb4c7b7cf', '096a59f1-8a71-467d-acf1-b9ff167ea912'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:04:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-517b90ef-8599-4d99-a405-806bcb098ac3 tempest-ServerRescueNegativeTestJSON-1243484177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:04:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-517b90ef-8599-4d99-a405-806bcb098ac3 tempest-ServerRescueNegativeTestJSON-1243484177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:04:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-517b90ef-8599-4d99-a405-806bcb098ac3 tempest-ServerRescueNegativeTestJSON-1243484177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:04:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-517b90ef-8599-4d99-a405-806bcb098ac3 tempest-ServerRescueNegativeTestJSON-1243484177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:04:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-517b90ef-8599-4d99-a405-806bcb098ac3 tempest-ServerRescueNegativeTestJSON-1243484177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:04:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-517b90ef-8599-4d99-a405-806bcb098ac3 tempest-ServerRescueNegativeTestJSON-1243484177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:04:51 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:04:51 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:04:52 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Sep 06 08:04:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-517b90ef-8599-4d99-a405-806bcb098ac3 tempest-ServerRescueNegativeTestJSON-1243484177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.588s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:04:52 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-517b90ef-8599-4d99-a405-806bcb098ac3 tempest-ServerRescueNegativeTestJSON-1243484177 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:04:52 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-517b90ef-8599-4d99-a405-806bcb098ac3 tempest-ServerRescueNegativeTestJSON-1243484177 None] Deleted volume successfully. Sep 06 08:04:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-517b90ef-8599-4d99-a405-806bcb098ac3 tempest-ServerRescueNegativeTestJSON-1243484177 None] Lock "cinder-c380de61-c82a-427a-be2d-0c2f12e81b6f-delete_volume" released by "delete_volume" :: held 2.618s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:04:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-aaa02df8-07a4-4b1e-93b1-8752fb1a7dde req-91d2894b-5c60-40de-a1ab-3dc94e2e5835 tempest-AttachVolumeShelveTestJSON-1247689438 None] No connector for attachment ce723914-46a0-4965-90e2-129c418d4a6a; skipping storage backend terminate_connection call. {{(pid=87307) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 06 08:04:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-aaa02df8-07a4-4b1e-93b1-8752fb1a7dde req-91d2894b-5c60-40de-a1ab-3dc94e2e5835 tempest-AttachVolumeShelveTestJSON-1247689438 None] Deleting attachment ce723914-46a0-4965-90e2-129c418d4a6a. {{(pid=87307) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 08:04:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:04:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:04:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:04:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:04:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:04:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:04:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:04:59 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:04:59 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:00 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.478s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:00 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:05:00 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager._thread_info {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:05:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread count: 8 {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 08:05:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread info: [<_MainThread(MainThread, started 139985167040640)>, , , , , , , ] {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:05:07 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-c2108f25-7c9d-4fa2-b50f-781909851e32 tempest-GroupSnapshotsTest-1472890853 None] Group tempest-GroupSnapshotsTest-Group-1604437110: creating Sep 06 08:05:08 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-c2108f25-7c9d-4fa2-b50f-781909851e32 tempest-GroupSnapshotsTest-1472890853 None] Group tempest-GroupSnapshotsTest-Group-1604437110: created successfully Sep 06 08:05:08 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-c2108f25-7c9d-4fa2-b50f-781909851e32 tempest-GroupSnapshotsTest-1472890853 None] Create group completed successfully. Sep 06 08:05:09 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:05:09 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Flow 'volume_create_manager' (39888bf3-e5d7-4b19-b51c-2913782b8704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:05:09 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7c1d53-db64-41c1-abd7-b5ef5ace4db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7c1d53-db64-41c1-abd7-b5ef5ace4db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-171166271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dd74cbf4-e1a0-4cb3-a7b2-e8e4783479a9,host='devstack@QuobyteHD#QuobyteHD',id=ece8a80e-dd5f-48a8-897c-9cb4fc84db56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a4e6cc4e6c4d5da94a7ab201730c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:05:10Z,use_quota=True,user_id='2670d520f5574714be375c35184af357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad54d8f3-47c1-4a50-bb25-70c6a0b9037f),volume_type_id=ad54d8f3-47c1-4a50-bb25-70c6a0b9037f)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5c4a55-80b0-4726-b285-3ce86d7bce11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5c4a55-80b0-4726-b285-3ce86d7bce11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74004f59-b994-4b9e-bdef-a064ca75c778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74004f59-b994-4b9e-bdef-a064ca75c778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ece8a80e-dd5f-48a8-897c-9cb4fc84db56', 'volume_name': 'volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0786b359-8249-4743-a6f7-53e388df119a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0786b359-8249-4743-a6f7-53e388df119a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6179fa-d123-408b-a7f5-d3356790747e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:10 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Volume ece8a80e-dd5f-48a8-897c-9cb4fc84db56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56', 'volume_size': 1} Sep 06 08:05:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:05:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:05:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dd74cbf4-e1a0-4cb3-a7b2-e8e4783479a9,created_at=2026-09-06T06:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-171166271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dd74cbf4-e1a0-4cb3-a7b2-e8e4783479a9,host='devstack@QuobyteHD#QuobyteHD',id=ece8a80e-dd5f-48a8-897c-9cb4fc84db56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a4e6cc4e6c4d5da94a7ab201730c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:05:10Z,use_quota=True,user_id='2670d520f5574714be375c35184af357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad54d8f3-47c1-4a50-bb25-70c6a0b9037f),volume_type_id=ad54d8f3-47c1-4a50-bb25-70c6a0b9037f)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:05:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Creating volume ece8a80e-dd5f-48a8-897c-9cb4fc84db56 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:05:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:05:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:05:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:05:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:05:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:05:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:05:10 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:05:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:10 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56 1073741824 Sep 06 08:05:10 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:11 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56 1073741824" returned: 0 in 1.087s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:11 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56 Sep 06 08:05:11 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:11 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56" returned: 0 in 0.313s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:05:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:05:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6179fa-d123-408b-a7f5-d3356790747e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c363538-3ef2-4d28-b326-a6941a7265c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:11 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Volume volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56 (ece8a80e-dd5f-48a8-897c-9cb4fc84db56): created successfully Sep 06 08:05:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c363538-3ef2-4d28-b326-a6941a7265c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Flow 'volume_create_manager' (39888bf3-e5d7-4b19-b51c-2913782b8704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:05:11 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-cb21dbe9-cc5f-4775-9627-03641395345b tempest-GroupSnapshotsTest-1472890853 None] Created volume successfully. Sep 06 08:05:13 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f80491ea-c863-41c1-8f39-7a1c3dd5deab tempest-GroupSnapshotsTest-1472890853 None] GroupSnapshot f748cd14-01fe-4871-b405-b8df1eaf6a97: creating. Sep 06 08:05:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f80491ea-c863-41c1-8f39-7a1c3dd5deab tempest-GroupSnapshotsTest-1472890853 None] Group snapshot f748cd14-01fe-4871-b405-b8df1eaf6a97: creating. {{(pid=87307) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 06 08:05:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f80491ea-c863-41c1-8f39-7a1c3dd5deab tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:05:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f80491ea-c863-41c1-8f39-7a1c3dd5deab tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:05:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f80491ea-c863-41c1-8f39-7a1c3dd5deab tempest-GroupSnapshotsTest-1472890853 None] Creating offline snapshot 3489786b-f686-46ca-bc5c-cb6b184b87ea of volume ece8a80e-dd5f-48a8-897c-9cb4fc84db56 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:05:13 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[280cdf1c-896e-4758-808f-8287574d8ca5]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:05:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f80491ea-c863-41c1-8f39-7a1c3dd5deab tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:13 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56 Sep 06 08:05:13 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:13 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f80491ea-c863-41c1-8f39-7a1c3dd5deab tempest-GroupSnapshotsTest-1472890853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56" returned: 0 in 0.485s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f80491ea-c863-41c1-8f39-7a1c3dd5deab tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.3489786b-f686-46ca-bc5c-cb6b184b87ea 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:13 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.3489786b-f686-46ca-bc5c-cb6b184b87ea 1G Sep 06 08:05:13 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:14 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f80491ea-c863-41c1-8f39-7a1c3dd5deab tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.3489786b-f686-46ca-bc5c-cb6b184b87ea 1G" returned: 0 in 0.438s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f80491ea-c863-41c1-8f39-7a1c3dd5deab tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.3489786b-f686-46ca-bc5c-cb6b184b87ea {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:14 devstack sudo[90553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.3489786b-f686-46ca-bc5c-cb6b184b87ea Sep 06 08:05:14 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:14 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f80491ea-c863-41c1-8f39-7a1c3dd5deab tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.3489786b-f686-46ca-bc5c-cb6b184b87ea" returned: 0 in 0.330s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:14 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-f80491ea-c863-41c1-8f39-7a1c3dd5deab tempest-GroupSnapshotsTest-1472890853 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.3489786b-f686-46ca-bc5c-cb6b184b87ea is being set with open permissions: ugo+rw: NotImplementedError Sep 06 08:05:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f80491ea-c863-41c1-8f39-7a1c3dd5deab tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.3489786b-f686-46ca-bc5c-cb6b184b87ea {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:14 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.3489786b-f686-46ca-bc5c-cb6b184b87ea Sep 06 08:05:14 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:14 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f80491ea-c863-41c1-8f39-7a1c3dd5deab tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.3489786b-f686-46ca-bc5c-cb6b184b87ea" returned: 0 in 0.320s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f80491ea-c863-41c1-8f39-7a1c3dd5deab tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:14 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.info Sep 06 08:05:14 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:15 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f80491ea-c863-41c1-8f39-7a1c3dd5deab tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.info" returned: 0 in 0.288s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:15 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-f80491ea-c863-41c1-8f39-7a1c3dd5deab tempest-GroupSnapshotsTest-1472890853 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.info is being set with open permissions: ugo+rw: NotImplementedError Sep 06 08:05:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f80491ea-c863-41c1-8f39-7a1c3dd5deab tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:15 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.info Sep 06 08:05:15 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:15 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f80491ea-c863-41c1-8f39-7a1c3dd5deab tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.info" returned: 0 in 0.323s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f80491ea-c863-41c1-8f39-7a1c3dd5deab tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.291s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:05:15 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f80491ea-c863-41c1-8f39-7a1c3dd5deab tempest-GroupSnapshotsTest-1472890853 None] group_snapshot f748cd14-01fe-4871-b405-b8df1eaf6a97: created successfully Sep 06 08:05:15 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:05:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Flow 'volume_create_manager' (e42b71ce-8cb2-4ada-a548-d00af3621188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:05:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dbf11b4-cd1c-4753-8a8a-b5f9bcc09256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dbf11b4-cd1c-4753-8a8a-b5f9bcc09256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-900384801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fffb2711-ccc9-468f-85fa-047d1a562d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3770341499244c44a72453503d965656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:05:16Z,use_quota=True,user_id='e515cc44e4ba46dc9af422b926914b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e2114d-42da-4e1a-a0fb-7f167dee7ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e2114d-42da-4e1a-a0fb-7f167dee7ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6558381-9534-436e-89ac-e09b9083b495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6558381-9534-436e-89ac-e09b9083b495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fffb2711-ccc9-468f-85fa-047d1a562d37', 'volume_name': 'volume-fffb2711-ccc9-468f-85fa-047d1a562d37', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d9da86-7041-4e4c-8ff8-f8b06ae3966f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d9da86-7041-4e4c-8ff8-f8b06ae3966f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a1b6f1-7b47-443a-ae2c-79294b3b63c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:16 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Volume fffb2711-ccc9-468f-85fa-047d1a562d37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fffb2711-ccc9-468f-85fa-047d1a562d37', 'volume_size': 1} Sep 06 08:05:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:05:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:05:16 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-900384801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fffb2711-ccc9-468f-85fa-047d1a562d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3770341499244c44a72453503d965656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:05:16Z,use_quota=True,user_id='e515cc44e4ba46dc9af422b926914b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:05:16 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Creating volume fffb2711-ccc9-468f-85fa-047d1a562d37 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:05:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:05:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:05:16 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:05:16 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:05:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:05:16 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:05:16 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:05:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fffb2711-ccc9-468f-85fa-047d1a562d37 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:16 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fffb2711-ccc9-468f-85fa-047d1a562d37 1073741824 Sep 06 08:05:16 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:16 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fffb2711-ccc9-468f-85fa-047d1a562d37 1073741824" returned: 0 in 0.815s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fffb2711-ccc9-468f-85fa-047d1a562d37 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:17 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fffb2711-ccc9-468f-85fa-047d1a562d37 Sep 06 08:05:17 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:17 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fffb2711-ccc9-468f-85fa-047d1a562d37" returned: 0 in 0.689s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "cinder-quobyte-3489786b-f686-46ca-bc5c-cb6b184b87ea-d6b9cc29-3660-411b-a31e-56f4fd9927dd" by "_create_volume_from_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a1b6f1-7b47-443a-ae2c-79294b3b63c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fffb2711-ccc9-468f-85fa-047d1a562d37', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c75f601-2c6f-42e8-a831-c754a4ff265d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-3489786b-f686-46ca-bc5c-cb6b184b87ea-d6b9cc29-3660-411b-a31e-56f4fd9927dd" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Creating volume d6b9cc29-3660-411b-a31e-56f4fd9927dd from snapshot 3489786b-f686-46ca-bc5c-cb6b184b87ea {{(pid=87307) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "cinder-quobyte-d6b9cc29-3660-411b-a31e-56f4fd9927dd" by "_copy_volume_from_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:05:17 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Volume volume-fffb2711-ccc9-468f-85fa-047d1a562d37 (fffb2711-ccc9-468f-85fa-047d1a562d37): created successfully Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c75f601-2c6f-42e8-a831-c754a4ff265d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Flow 'volume_create_manager' (e42b71ce-8cb2-4ada-a548-d00af3621188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:05:17 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-6b619f32-b6f3-4ee0-ab9c-8aa5f4186eb4 tempest-ServerActionsTestOtherA-1802890097 None] Created volume successfully. Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-d6b9cc29-3660-411b-a31e-56f4fd9927dd" acquired by "_copy_volume_from_snapshot" :: waited 0.051s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] snapshot: 3489786b-f686-46ca-bc5c-cb6b184b87ea, volume: d6b9cc29-3660-411b-a31e-56f4fd9927dd, {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5007f17-c0ed-49f5-88b0-dbdbb27ca991]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:05:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.3489786b-f686-46ca-bc5c-cb6b184b87ea {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:18 devstack sudo[90580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.3489786b-f686-46ca-bc5c-cb6b184b87ea Sep 06 08:05:18 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:18 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.3489786b-f686-46ca-bc5c-cb6b184b87ea" returned: 0 in 0.640s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:18 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:05:18 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a345d6f3-884b-4a5c-a5f2-89f940e091fd]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:05:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:18 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56 Sep 06 08:05:18 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:19 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56" returned: 0 in 0.619s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] will copy from snapshot at /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56 {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 06 08:05:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Creating direct copy from snapshot {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 06 08:05:19 devstack cinder-volume[87307]: DEBUG cinder.utils [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Path /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6b9cc29-3660-411b-a31e-56f4fd9927dd not found in is_blk_device check {{(pid=87307) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 06 08:05:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6b9cc29-3660-411b-a31e-56f4fd9927dd {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:19 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6b9cc29-3660-411b-a31e-56f4fd9927dd Sep 06 08:05:19 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:27 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6b9cc29-3660-411b-a31e-56f4fd9927dd" returned: 0 in 8.579s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:27 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Image conversion details: src /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56, size 1024.00 MB, duration 8.58 sec, destination /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6b9cc29-3660-411b-a31e-56f4fd9927dd {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:05:27 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Converted 1024.00 MB image at 119.32 MB/s Sep 06 08:05:27 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6b9cc29-3660-411b-a31e-56f4fd9927dd is being set with open permissions: ugo+rw: NotImplementedError Sep 06 08:05:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6b9cc29-3660-411b-a31e-56f4fd9927dd {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:27 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:UPDATE=18,cinder:SELECT=23,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:05:27 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=17,cinder:INSERT=3,cinder:UPDATE=16,cinder:DELETE=2 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:05:27 devstack sudo[90651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6b9cc29-3660-411b-a31e-56f4fd9927dd Sep 06 08:05:27 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:28 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6b9cc29-3660-411b-a31e-56f4fd9927dd" returned: 0 in 0.367s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-d6b9cc29-3660-411b-a31e-56f4fd9927dd" released by "_copy_volume_from_snapshot" :: held 10.386s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:05:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-3489786b-f686-46ca-bc5c-cb6b184b87ea-d6b9cc29-3660-411b-a31e-56f4fd9927dd" released by "_create_volume_from_snapshot" :: held 10.515s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:05:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.563s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:05:28 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-800dbfc4-eca9-482b-a546-a1a335977a2c tempest-GroupSnapshotsTest-1472890853 None] Create group from source-snapshot-f748cd14-01fe-4871-b405-b8df1eaf6a97 completed successfully. Sep 06 08:05:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-497e5e0b-75cb-4ae8-8c37-95cc2f842101 tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "cinder-quobyte-d6b9cc29-3660-411b-a31e-56f4fd9927dd" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:05:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-497e5e0b-75cb-4ae8-8c37-95cc2f842101 tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-d6b9cc29-3660-411b-a31e-56f4fd9927dd" acquired by "delete_volume" :: waited 0.024s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:05:29 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1409b15-a7b2-445f-8ee7-fa8f11a15ea2]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:05:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-497e5e0b-75cb-4ae8-8c37-95cc2f842101 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6b9cc29-3660-411b-a31e-56f4fd9927dd {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:30 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6b9cc29-3660-411b-a31e-56f4fd9927dd Sep 06 08:05:30 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:30 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-497e5e0b-75cb-4ae8-8c37-95cc2f842101 tempest-GroupSnapshotsTest-1472890853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6b9cc29-3660-411b-a31e-56f4fd9927dd" returned: 0 in 0.567s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-497e5e0b-75cb-4ae8-8c37-95cc2f842101 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6b9cc29-3660-411b-a31e-56f4fd9927dd {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:30 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6b9cc29-3660-411b-a31e-56f4fd9927dd Sep 06 08:05:30 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:30 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-497e5e0b-75cb-4ae8-8c37-95cc2f842101 tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6b9cc29-3660-411b-a31e-56f4fd9927dd" returned: 0 in 0.506s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:30 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-497e5e0b-75cb-4ae8-8c37-95cc2f842101 tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-d6b9cc29-3660-411b-a31e-56f4fd9927dd" released by "delete_volume" :: held 1.149s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:05:31 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-497e5e0b-75cb-4ae8-8c37-95cc2f842101 tempest-GroupSnapshotsTest-1472890853 None] Created reservations ['1803b68a-5c21-4c16-824d-82bce929e7eb'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:05:31 devstack cinder-volume[87307]: WARNING cinder.quota [None req-497e5e0b-75cb-4ae8-8c37-95cc2f842101 tempest-GroupSnapshotsTest-1472890853 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1305408536 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1305408536, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:05:31 devstack cinder-volume[87307]: WARNING cinder.quota [None req-497e5e0b-75cb-4ae8-8c37-95cc2f842101 tempest-GroupSnapshotsTest-1472890853 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1305408536 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1305408536, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:05:31 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-497e5e0b-75cb-4ae8-8c37-95cc2f842101 tempest-GroupSnapshotsTest-1472890853 None] Created reservations ['02974f96-51dc-4b83-935e-18f6bb63c37c', 'd4a9c923-a735-434d-b1aa-87cf4b85748c', 'b46bd1a0-20f5-4981-8ec1-5aa7aea08986', '01eb3878-9877-426c-bbf7-6bcf61b183fa'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:05:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-497e5e0b-75cb-4ae8-8c37-95cc2f842101 tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:05:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-497e5e0b-75cb-4ae8-8c37-95cc2f842101 tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:05:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-497e5e0b-75cb-4ae8-8c37-95cc2f842101 tempest-GroupSnapshotsTest-1472890853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:05:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-497e5e0b-75cb-4ae8-8c37-95cc2f842101 tempest-GroupSnapshotsTest-1472890853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:05:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-497e5e0b-75cb-4ae8-8c37-95cc2f842101 tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:05:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-497e5e0b-75cb-4ae8-8c37-95cc2f842101 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:31 devstack sudo[90708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:05:31 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:31 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-497e5e0b-75cb-4ae8-8c37-95cc2f842101 tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.399s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:31 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-497e5e0b-75cb-4ae8-8c37-95cc2f842101 tempest-GroupSnapshotsTest-1472890853 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:05:31 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-497e5e0b-75cb-4ae8-8c37-95cc2f842101 tempest-GroupSnapshotsTest-1472890853 None] Delete group completed successfully. Sep 06 08:05:32 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-bc5842ce-ba14-4d74-b19b-c829bf063f58 tempest-GroupSnapshotsTest-1472890853 None] group_snapshot f748cd14-01fe-4871-b405-b8df1eaf6a97: deleting Sep 06 08:05:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc5842ce-ba14-4d74-b19b-c829bf063f58 tempest-GroupSnapshotsTest-1472890853 None] group_snapshot f748cd14-01fe-4871-b405-b8df1eaf6a97: deleting {{(pid=87307) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 06 08:05:32 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bc5842ce-ba14-4d74-b19b-c829bf063f58 tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "cinder-quobyte-ece8a80e-dd5f-48a8-897c-9cb4fc84db56" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:05:32 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bc5842ce-ba14-4d74-b19b-c829bf063f58 tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-ece8a80e-dd5f-48a8-897c-9cb4fc84db56" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:05:32 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bc5842ce-ba14-4d74-b19b-c829bf063f58 tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "cinder-quobyte-3489786b-f686-46ca-bc5c-cb6b184b87ea" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:05:32 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bc5842ce-ba14-4d74-b19b-c829bf063f58 tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-3489786b-f686-46ca-bc5c-cb6b184b87ea" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:05:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-bc5842ce-ba14-4d74-b19b-c829bf063f58 tempest-GroupSnapshotsTest-1472890853 None] Deleting offline snapshot 3489786b-f686-46ca-bc5c-cb6b184b87ea of volume ece8a80e-dd5f-48a8-897c-9cb4fc84db56 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:05:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-bc5842ce-ba14-4d74-b19b-c829bf063f58 tempest-GroupSnapshotsTest-1472890853 None] snapshot_file for this snap is: volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.3489786b-f686-46ca-bc5c-cb6b184b87ea {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:05:32 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9479e0-294f-47ec-ba1e-8e708ac25215]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:05:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc5842ce-ba14-4d74-b19b-c829bf063f58 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.3489786b-f686-46ca-bc5c-cb6b184b87ea {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:33 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.3489786b-f686-46ca-bc5c-cb6b184b87ea Sep 06 08:05:33 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:33 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc5842ce-ba14-4d74-b19b-c829bf063f58 tempest-GroupSnapshotsTest-1472890853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.3489786b-f686-46ca-bc5c-cb6b184b87ea" returned: 0 in 0.611s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-bc5842ce-ba14-4d74-b19b-c829bf063f58 tempest-GroupSnapshotsTest-1472890853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:05:33 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ca5718-41b3-44e8-86b3-ac1233959d6b]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:05:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc5842ce-ba14-4d74-b19b-c829bf063f58 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:33 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56 Sep 06 08:05:33 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:34 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc5842ce-ba14-4d74-b19b-c829bf063f58 tempest-GroupSnapshotsTest-1472890853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56" returned: 0 in 0.892s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc5842ce-ba14-4d74-b19b-c829bf063f58 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.3489786b-f686-46ca-bc5c-cb6b184b87ea {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:34 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.3489786b-f686-46ca-bc5c-cb6b184b87ea Sep 06 08:05:34 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:35 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc5842ce-ba14-4d74-b19b-c829bf063f58 tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.3489786b-f686-46ca-bc5c-cb6b184b87ea" returned: 0 in 0.770s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc5842ce-ba14-4d74-b19b-c829bf063f58 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.3489786b-f686-46ca-bc5c-cb6b184b87ea {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:35 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.3489786b-f686-46ca-bc5c-cb6b184b87ea Sep 06 08:05:35 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:35 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc5842ce-ba14-4d74-b19b-c829bf063f58 tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56.3489786b-f686-46ca-bc5c-cb6b184b87ea" returned: 0 in 0.454s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:35 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bc5842ce-ba14-4d74-b19b-c829bf063f58 tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-3489786b-f686-46ca-bc5c-cb6b184b87ea" released by "_delete_snapshot" :: held 2.919s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:05:35 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bc5842ce-ba14-4d74-b19b-c829bf063f58 tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-ece8a80e-dd5f-48a8-897c-9cb4fc84db56" released by "delete_snapshot" :: held 2.985s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:05:35 devstack cinder-volume[87307]: WARNING cinder.quota [None req-bc5842ce-ba14-4d74-b19b-c829bf063f58 tempest-GroupSnapshotsTest-1472890853 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1305408536 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1305408536, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:05:35 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-bc5842ce-ba14-4d74-b19b-c829bf063f58 tempest-GroupSnapshotsTest-1472890853 None] Created reservations ['4cf05998-22b0-423f-b3f9-e5a175a56354', '9cd32204-690f-4740-85d5-e570a5178f78', 'c297451f-8636-44bd-8170-3b21268f8fc3', 'b8fabf1c-4a41-43d6-8832-6b41e1502d42'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:05:36 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-bc5842ce-ba14-4d74-b19b-c829bf063f58 tempest-GroupSnapshotsTest-1472890853 None] group_snapshot f748cd14-01fe-4871-b405-b8df1eaf6a97: deleted successfully Sep 06 08:05:36 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-dbb321a3-b573-4f40-ac23-cacf519256fc tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "cinder-quobyte-ece8a80e-dd5f-48a8-897c-9cb4fc84db56" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:05:36 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-dbb321a3-b573-4f40-ac23-cacf519256fc tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-ece8a80e-dd5f-48a8-897c-9cb4fc84db56" acquired by "delete_volume" :: waited 0.025s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:05:36 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[285b7044-f867-4d84-9e21-26af2cae093a]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:05:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dbb321a3-b573-4f40-ac23-cacf519256fc tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:37 devstack sudo[90765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56 Sep 06 08:05:37 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:37 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dbb321a3-b573-4f40-ac23-cacf519256fc tempest-GroupSnapshotsTest-1472890853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56" returned: 0 in 0.660s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dbb321a3-b573-4f40-ac23-cacf519256fc tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:37 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56 Sep 06 08:05:37 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:37 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dbb321a3-b573-4f40-ac23-cacf519256fc tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ece8a80e-dd5f-48a8-897c-9cb4fc84db56" returned: 0 in 0.363s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:37 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-dbb321a3-b573-4f40-ac23-cacf519256fc tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-ece8a80e-dd5f-48a8-897c-9cb4fc84db56" released by "delete_volume" :: held 1.118s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:05:38 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-dbb321a3-b573-4f40-ac23-cacf519256fc tempest-GroupSnapshotsTest-1472890853 None] Created reservations ['6256366f-63b3-421f-9c5f-854aca53d206'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:05:38 devstack cinder-volume[87307]: WARNING cinder.db.api [None req-dbb321a3-b573-4f40-ac23-cacf519256fc tempest-GroupSnapshotsTest-1472890853 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1305408536'] Sep 06 08:05:38 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-dbb321a3-b573-4f40-ac23-cacf519256fc tempest-GroupSnapshotsTest-1472890853 None] Created reservations ['e80874df-8c62-40df-82d0-2934a1fea091', '5b6ea882-967e-41c6-bb06-b37607dd3e66', 'c3ce36f9-998e-497a-ad3b-9b32323223fa', 'ef4456c3-58a7-41e4-8749-6ccffac55795'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:05:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dbb321a3-b573-4f40-ac23-cacf519256fc tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:05:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dbb321a3-b573-4f40-ac23-cacf519256fc tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:05:38 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-dbb321a3-b573-4f40-ac23-cacf519256fc tempest-GroupSnapshotsTest-1472890853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:05:38 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-dbb321a3-b573-4f40-ac23-cacf519256fc tempest-GroupSnapshotsTest-1472890853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:05:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dbb321a3-b573-4f40-ac23-cacf519256fc tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:05:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dbb321a3-b573-4f40-ac23-cacf519256fc tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:38 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:05:38 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:39 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dbb321a3-b573-4f40-ac23-cacf519256fc tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.658s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:39 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-dbb321a3-b573-4f40-ac23-cacf519256fc tempest-GroupSnapshotsTest-1472890853 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:05:39 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-dbb321a3-b573-4f40-ac23-cacf519256fc tempest-GroupSnapshotsTest-1472890853 None] Delete group completed successfully. Sep 06 08:05:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-32c659ba-1f5d-4811-8815-bf9bdd824cab tempest-AttachVolumeShelveTestJSON-1247689438 None] Acquiring lock "cinder-626564de-d544-4f50-9e32-4d9bb2410af0-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:05:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-32c659ba-1f5d-4811-8815-bf9bdd824cab tempest-AttachVolumeShelveTestJSON-1247689438 None] Lock "cinder-626564de-d544-4f50-9e32-4d9bb2410af0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:05:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-32c659ba-1f5d-4811-8815-bf9bdd824cab tempest-AttachVolumeShelveTestJSON-1247689438 None] Acquiring lock "cinder-quobyte-626564de-d544-4f50-9e32-4d9bb2410af0" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:05:40 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-cb4e9c0d-cac2-43c0-822c-cc56eab89e27 tempest-GroupSnapshotsTest-1472890853 None] Group tempest-GroupSnapshotsTest-Group-265797691: creating Sep 06 08:05:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-32c659ba-1f5d-4811-8815-bf9bdd824cab tempest-AttachVolumeShelveTestJSON-1247689438 None] Lock "cinder-quobyte-626564de-d544-4f50-9e32-4d9bb2410af0" acquired by "delete_volume" :: waited 0.044s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:05:40 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-cb4e9c0d-cac2-43c0-822c-cc56eab89e27 tempest-GroupSnapshotsTest-1472890853 None] Group tempest-GroupSnapshotsTest-Group-265797691: created successfully Sep 06 08:05:40 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cd17fd-df31-4d41-8e24-1e4b26425d80]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:05:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-32c659ba-1f5d-4811-8815-bf9bdd824cab tempest-AttachVolumeShelveTestJSON-1247689438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-626564de-d544-4f50-9e32-4d9bb2410af0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:40 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-cb4e9c0d-cac2-43c0-822c-cc56eab89e27 tempest-GroupSnapshotsTest-1472890853 None] Create group completed successfully. Sep 06 08:05:40 devstack sudo[90821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-626564de-d544-4f50-9e32-4d9bb2410af0 Sep 06 08:05:40 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:41 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-32c659ba-1f5d-4811-8815-bf9bdd824cab tempest-AttachVolumeShelveTestJSON-1247689438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-626564de-d544-4f50-9e32-4d9bb2410af0" returned: 0 in 0.620s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-32c659ba-1f5d-4811-8815-bf9bdd824cab tempest-AttachVolumeShelveTestJSON-1247689438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-626564de-d544-4f50-9e32-4d9bb2410af0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:41 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-626564de-d544-4f50-9e32-4d9bb2410af0 Sep 06 08:05:41 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:41 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-32c659ba-1f5d-4811-8815-bf9bdd824cab tempest-AttachVolumeShelveTestJSON-1247689438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-626564de-d544-4f50-9e32-4d9bb2410af0" returned: 0 in 0.519s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:41 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-32c659ba-1f5d-4811-8815-bf9bdd824cab tempest-AttachVolumeShelveTestJSON-1247689438 None] Lock "cinder-quobyte-626564de-d544-4f50-9e32-4d9bb2410af0" released by "delete_volume" :: held 1.238s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:05:41 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-32c659ba-1f5d-4811-8815-bf9bdd824cab tempest-AttachVolumeShelveTestJSON-1247689438 None] Created reservations ['e6751b9d-1a04-44f6-96bd-9e587e2d41e4', 'c7deb13b-1916-41aa-b2dc-f3604758e8b6', 'a358e8f9-a01b-451b-9dea-7756aa6a6211', '2dcc9c28-261d-4e3d-98ea-5b3b33ee275a'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:05:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-32c659ba-1f5d-4811-8815-bf9bdd824cab tempest-AttachVolumeShelveTestJSON-1247689438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:05:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-32c659ba-1f5d-4811-8815-bf9bdd824cab tempest-AttachVolumeShelveTestJSON-1247689438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:05:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-32c659ba-1f5d-4811-8815-bf9bdd824cab tempest-AttachVolumeShelveTestJSON-1247689438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:05:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-32c659ba-1f5d-4811-8815-bf9bdd824cab tempest-AttachVolumeShelveTestJSON-1247689438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:05:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-32c659ba-1f5d-4811-8815-bf9bdd824cab tempest-AttachVolumeShelveTestJSON-1247689438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:05:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-32c659ba-1f5d-4811-8815-bf9bdd824cab tempest-AttachVolumeShelveTestJSON-1247689438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:41 devstack sudo[90845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:05:41 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:42 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-32c659ba-1f5d-4811-8815-bf9bdd824cab tempest-AttachVolumeShelveTestJSON-1247689438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.375s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-32c659ba-1f5d-4811-8815-bf9bdd824cab tempest-AttachVolumeShelveTestJSON-1247689438 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:05:42 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-32c659ba-1f5d-4811-8815-bf9bdd824cab tempest-AttachVolumeShelveTestJSON-1247689438 None] Deleted volume successfully. Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-32c659ba-1f5d-4811-8815-bf9bdd824cab tempest-AttachVolumeShelveTestJSON-1247689438 None] Lock "cinder-626564de-d544-4f50-9e32-4d9bb2410af0-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Flow 'volume_create_manager' (0c1bec1a-c7a6-41ed-ad46-0169f5ffed94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03fc3932-22f7-436c-a702-48a8afa6d540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03fc3932-22f7-436c-a702-48a8afa6d540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2121712479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea6b176a-b4c1-4e8a-86d7-e97510a8bca5,host='devstack@QuobyteHD#QuobyteHD',id=5443ab19-b31b-4561-9df6-1805a52f6465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a4e6cc4e6c4d5da94a7ab201730c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:05:42Z,use_quota=True,user_id='2670d520f5574714be375c35184af357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3a5d7f3-284f-4709-adac-1e48e2cfc450),volume_type_id=c3a5d7f3-284f-4709-adac-1e48e2cfc450)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b2bc3e-7f19-4f86-bae9-b0a30f85c9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b2bc3e-7f19-4f86-bae9-b0a30f85c9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b5c9f5-92c4-4b0c-98df-ce6a326db31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b5c9f5-92c4-4b0c-98df-ce6a326db31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5443ab19-b31b-4561-9df6-1805a52f6465', 'volume_name': 'volume-5443ab19-b31b-4561-9df6-1805a52f6465', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d7d9e3-d858-4016-8b0e-334aebf115e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d7d9e3-d858-4016-8b0e-334aebf115e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ded373-4f4a-4fe9-904c-1ddb0d372e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:42 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Volume 5443ab19-b31b-4561-9df6-1805a52f6465: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5443ab19-b31b-4561-9df6-1805a52f6465', 'volume_size': 1} Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ea6b176a-b4c1-4e8a-86d7-e97510a8bca5,created_at=2026-09-06T06:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2121712479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea6b176a-b4c1-4e8a-86d7-e97510a8bca5,host='devstack@QuobyteHD#QuobyteHD',id=5443ab19-b31b-4561-9df6-1805a52f6465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a4e6cc4e6c4d5da94a7ab201730c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:05:42Z,use_quota=True,user_id='2670d520f5574714be375c35184af357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3a5d7f3-284f-4709-adac-1e48e2cfc450),volume_type_id=c3a5d7f3-284f-4709-adac-1e48e2cfc450)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Creating volume 5443ab19-b31b-4561-9df6-1805a52f6465 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:05:42 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:42 devstack sudo[90848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465 1073741824 Sep 06 08:05:42 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:42 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465 1073741824" returned: 0 in 0.547s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:43 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465 Sep 06 08:05:43 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:43 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465" returned: 0 in 0.305s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:43 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:05:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:05:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ded373-4f4a-4fe9-904c-1ddb0d372e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5443ab19-b31b-4561-9df6-1805a52f6465', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa0213e-7cbf-46aa-b814-f91ac17191c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:43 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Volume volume-5443ab19-b31b-4561-9df6-1805a52f6465 (5443ab19-b31b-4561-9df6-1805a52f6465): created successfully Sep 06 08:05:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa0213e-7cbf-46aa-b814-f91ac17191c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Flow 'volume_create_manager' (0c1bec1a-c7a6-41ed-ad46-0169f5ffed94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:05:43 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-01016299-44d7-4eb3-a175-3b7332ffe151 tempest-GroupSnapshotsTest-1472890853 None] Created volume successfully. Sep 06 08:05:44 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:05:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Flow 'volume_create_manager' (49671841-c061-45b2-a715-98b142130034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:05:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac37498-db83-4b9b-976f-f36c47e0bf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac37498-db83-4b9b-976f-f36c47e0bf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1899082392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea6b176a-b4c1-4e8a-86d7-e97510a8bca5,host='devstack@QuobyteHD#QuobyteHD',id=360b751e-8a79-4ecb-a880-99a1cc04f24c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a4e6cc4e6c4d5da94a7ab201730c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:05:45Z,use_quota=True,user_id='2670d520f5574714be375c35184af357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3a5d7f3-284f-4709-adac-1e48e2cfc450),volume_type_id=c3a5d7f3-284f-4709-adac-1e48e2cfc450)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e19b0a50-1ab8-41cf-94af-5f5db272be6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e19b0a50-1ab8-41cf-94af-5f5db272be6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5a9fc2-005a-42dd-990e-ab2a1e7de8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5a9fc2-005a-42dd-990e-ab2a1e7de8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '360b751e-8a79-4ecb-a880-99a1cc04f24c', 'volume_name': 'volume-360b751e-8a79-4ecb-a880-99a1cc04f24c', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7adf452-4472-45d8-8c28-d3a37f853000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7adf452-4472-45d8-8c28-d3a37f853000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68f7c4e-fed0-45e3-9cc8-eb9e4d4c4954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:45 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Volume 360b751e-8a79-4ecb-a880-99a1cc04f24c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-360b751e-8a79-4ecb-a880-99a1cc04f24c', 'volume_size': 1} Sep 06 08:05:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:05:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:05:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ea6b176a-b4c1-4e8a-86d7-e97510a8bca5,created_at=2026-09-06T06:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1899082392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea6b176a-b4c1-4e8a-86d7-e97510a8bca5,host='devstack@QuobyteHD#QuobyteHD',id=360b751e-8a79-4ecb-a880-99a1cc04f24c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a4e6cc4e6c4d5da94a7ab201730c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:05:45Z,use_quota=True,user_id='2670d520f5574714be375c35184af357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3a5d7f3-284f-4709-adac-1e48e2cfc450),volume_type_id=c3a5d7f3-284f-4709-adac-1e48e2cfc450)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:05:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Creating volume 360b751e-8a79-4ecb-a880-99a1cc04f24c {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:05:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:05:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:05:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:05:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:05:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:05:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:05:45 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:05:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:45 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c 1073741824 Sep 06 08:05:45 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:46 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c 1073741824" returned: 0 in 0.890s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:46 devstack sudo[90950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c Sep 06 08:05:46 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:46 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c" returned: 0 in 0.419s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:05:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:05:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68f7c4e-fed0-45e3-9cc8-eb9e4d4c4954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-360b751e-8a79-4ecb-a880-99a1cc04f24c', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ed1350-c235-4a20-a7ca-e866b8f7b5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:46 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Volume volume-360b751e-8a79-4ecb-a880-99a1cc04f24c (360b751e-8a79-4ecb-a880-99a1cc04f24c): created successfully Sep 06 08:05:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ed1350-c235-4a20-a7ca-e866b8f7b5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Flow 'volume_create_manager' (49671841-c061-45b2-a715-98b142130034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:05:46 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-ec9bd654-5b15-47f7-8fe2-361e8c4baa35 tempest-GroupSnapshotsTest-1472890853 None] Created volume successfully. Sep 06 08:05:47 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-2ea15be2-e55c-4b63-a811-ccd4a7946e79 tempest-GroupSnapshotsTest-1472890853 None] Update group completed successfully. Sep 06 08:05:49 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-de1315e9-73aa-4ba4-82af-ea815d352e0b tempest-GroupSnapshotsTest-1472890853 None] Update group completed successfully. Sep 06 08:05:50 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-88cad01f-010a-4c22-be8f-be7c4c2e7464 tempest-GroupSnapshotsTest-1472890853 None] Update group completed successfully. Sep 06 08:05:51 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-41219576-add3-45db-b1d7-ee22164057a3 tempest-GroupSnapshotsTest-1472890853 None] Update group completed successfully. Sep 06 08:05:53 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:05:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Flow 'volume_create_manager' (232bec2f-da83-40ef-8da9-4773e3b395e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:05:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d54a88-4f9d-4789-b459-a2e984ea122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d54a88-4f9d-4789-b459-a2e984ea122d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1249357990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22981576-4ae8-4853-98a1-83846232d4e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a59823f2c67408894ffc9717529dc50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:05:53Z,use_quota=True,user_id='c3c250e6eb7842ff8e94abe2859a24bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (299aff4c-fb34-40de-b1d7-910a2a3363bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (299aff4c-fb34-40de-b1d7-910a2a3363bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d85ed10-aa28-4963-9902-cbcbfadad89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d85ed10-aa28-4963-9902-cbcbfadad89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22981576-4ae8-4853-98a1-83846232d4e3', 'volume_name': 'volume-22981576-4ae8-4853-98a1-83846232d4e3', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dfe7e06-28d0-4453-876d-c4bf3d6ed575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dfe7e06-28d0-4453-876d-c4bf3d6ed575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4503a5ce-6356-4eaf-a87d-ea2b0b1a4a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:53 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Volume 22981576-4ae8-4853-98a1-83846232d4e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22981576-4ae8-4853-98a1-83846232d4e3', 'volume_size': 1} Sep 06 08:05:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:05:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:05:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1249357990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22981576-4ae8-4853-98a1-83846232d4e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a59823f2c67408894ffc9717529dc50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:05:53Z,use_quota=True,user_id='c3c250e6eb7842ff8e94abe2859a24bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:05:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Creating volume 22981576-4ae8-4853-98a1-83846232d4e3 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:05:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:05:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:05:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:05:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:05:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:05:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:05:53 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:05:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:53 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] GroupSnapshot ef9a6802-0ace-48a6-a60a-1c16e28d5500: creating. Sep 06 08:05:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] Group snapshot ef9a6802-0ace-48a6-a60a-1c16e28d5500: creating. {{(pid=87307) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 06 08:05:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:05:53 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3 1073741824 Sep 06 08:05:53 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:54 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3 1073741824" returned: 0 in 0.617s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:54 devstack sudo[90992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3 Sep 06 08:05:54 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:54 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3" returned: 0 in 0.458s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:05:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:05:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.044s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:05:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4503a5ce-6356-4eaf-a87d-ea2b0b1a4a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22981576-4ae8-4853-98a1-83846232d4e3', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5029087f-91d1-40b3-94b9-ad40adbdcf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:05:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] Creating offline snapshot 40cd29ca-7da3-4fdf-9945-f3eccf909f91 of volume 5443ab19-b31b-4561-9df6-1805a52f6465 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:05:54 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Volume volume-22981576-4ae8-4853-98a1-83846232d4e3 (22981576-4ae8-4853-98a1-83846232d4e3): created successfully Sep 06 08:05:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5029087f-91d1-40b3-94b9-ad40adbdcf8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:05:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Flow 'volume_create_manager' (232bec2f-da83-40ef-8da9-4773e3b395e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:05:54 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4297fe0e-a40d-4688-9c7c-6e8308e81b07]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:05:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:54 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-7d02a052-245e-4941-98a1-997b105da849 req-8132e790-31e4-45b4-9766-c0c823c598eb tempest-VolumesSnapshotsTestJSON-1881546682 None] Created volume successfully. Sep 06 08:05:54 devstack sudo[90996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465 Sep 06 08:05:54 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:55 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465" returned: 0 in 0.417s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.40cd29ca-7da3-4fdf-9945-f3eccf909f91 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:55 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.40cd29ca-7da3-4fdf-9945-f3eccf909f91 1G Sep 06 08:05:55 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:55 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.40cd29ca-7da3-4fdf-9945-f3eccf909f91 1G" returned: 0 in 0.455s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5443ab19-b31b-4561-9df6-1805a52f6465 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.40cd29ca-7da3-4fdf-9945-f3eccf909f91 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:55 devstack sudo[91007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5443ab19-b31b-4561-9df6-1805a52f6465 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.40cd29ca-7da3-4fdf-9945-f3eccf909f91 Sep 06 08:05:55 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-bc859490-3239-4ede-ab40-0e45522e53b1 req-bbdd6844-0d1f-4ce6-9bfe-a0d680aac1e8 tempest-VolumesSnapshotsTestJSON-1881546682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:05:56 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5443ab19-b31b-4561-9df6-1805a52f6465 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.40cd29ca-7da3-4fdf-9945-f3eccf909f91" returned: 0 in 0.415s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:56 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.40cd29ca-7da3-4fdf-9945-f3eccf909f91 is being set with open permissions: ugo+rw: NotImplementedError Sep 06 08:05:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.40cd29ca-7da3-4fdf-9945-f3eccf909f91 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:56 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.40cd29ca-7da3-4fdf-9945-f3eccf909f91 Sep 06 08:05:56 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:56 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.40cd29ca-7da3-4fdf-9945-f3eccf909f91" returned: 0 in 0.300s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:56 devstack sudo[91019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.info Sep 06 08:05:56 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:56 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.info" returned: 0 in 0.274s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:56 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.info is being set with open permissions: ugo+rw: NotImplementedError Sep 06 08:05:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:56 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.info Sep 06 08:05:56 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:57 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.info" returned: 0 in 0.280s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.287s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:05:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:05:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:05:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] Creating offline snapshot 48fe9409-fea9-4437-86e5-57feb34d72cb of volume 360b751e-8a79-4ecb-a880-99a1cc04f24c {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:05:57 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd695026-75df-4231-bed7-f58fcdf8a634]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:05:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:57 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c Sep 06 08:05:57 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:57 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c" returned: 0 in 0.447s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.48fe9409-fea9-4437-86e5-57feb34d72cb 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:57 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.48fe9409-fea9-4437-86e5-57feb34d72cb 1G Sep 06 08:05:57 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:57 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.48fe9409-fea9-4437-86e5-57feb34d72cb 1G" returned: 0 in 0.450s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-360b751e-8a79-4ecb-a880-99a1cc04f24c -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.48fe9409-fea9-4437-86e5-57feb34d72cb {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:58 devstack sudo[91040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-360b751e-8a79-4ecb-a880-99a1cc04f24c -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.48fe9409-fea9-4437-86e5-57feb34d72cb Sep 06 08:05:58 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:58 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-360b751e-8a79-4ecb-a880-99a1cc04f24c -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.48fe9409-fea9-4437-86e5-57feb34d72cb" returned: 0 in 0.330s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:58 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.48fe9409-fea9-4437-86e5-57feb34d72cb is being set with open permissions: ugo+rw: NotImplementedError Sep 06 08:05:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.48fe9409-fea9-4437-86e5-57feb34d72cb {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:58 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.48fe9409-fea9-4437-86e5-57feb34d72cb Sep 06 08:05:58 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:58 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.48fe9409-fea9-4437-86e5-57feb34d72cb" returned: 0 in 0.325s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:58 devstack sudo[91057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.info Sep 06 08:05:58 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-7333725b-53bd-4f81-8cf7-3ec00ba5c4ae req-4b625748-714b-473c-99f3-c028cce25608 tempest-ServerActionsTestOtherA-1802890097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:05:58 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.info" returned: 0 in 0.305s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:58 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 06 08:05:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:59 devstack sudo[91080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.info Sep 06 08:05:59 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:59 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.info" returned: 0 in 0.254s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.214s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:05:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-bc859490-3239-4ede-ab40-0e45522e53b1 req-bbdd6844-0d1f-4ce6-9bfe-a0d680aac1e8 tempest-VolumesSnapshotsTestJSON-1881546682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.286s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:05:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [req-bc859490-3239-4ede-ab40-0e45522e53b1 req-bbdd6844-0d1f-4ce6-9bfe-a0d680aac1e8 tempest-VolumesSnapshotsTestJSON-1881546682 None] Creating offline snapshot 62998f58-7ae7-4740-8341-396784dd6c14 of volume 22981576-4ae8-4853-98a1-83846232d4e3 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:05:59 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fa2b3d-4f55-4e5f-98f0-38641ca23b3d]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:05:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-bc859490-3239-4ede-ab40-0e45522e53b1 req-bbdd6844-0d1f-4ce6-9bfe-a0d680aac1e8 tempest-VolumesSnapshotsTestJSON-1881546682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:59 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-cabbdba2-79b9-4225-875d-5a03ee120627 tempest-GroupSnapshotsTest-1472890853 None] group_snapshot ef9a6802-0ace-48a6-a60a-1c16e28d5500: created successfully Sep 06 08:05:59 devstack sudo[91083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3 Sep 06 08:05:59 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:05:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:05:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:05:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:05:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:05:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:05:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:59 devstack sudo[91088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:05:59 devstack sudo[91088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:59 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-bc859490-3239-4ede-ab40-0e45522e53b1 req-bbdd6844-0d1f-4ce6-9bfe-a0d680aac1e8 tempest-VolumesSnapshotsTestJSON-1881546682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3" returned: 0 in 0.404s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-bc859490-3239-4ede-ab40-0e45522e53b1 req-bbdd6844-0d1f-4ce6-9bfe-a0d680aac1e8 tempest-VolumesSnapshotsTestJSON-1881546682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.62998f58-7ae7-4740-8341-396784dd6c14 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:05:59 devstack sudo[91090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.62998f58-7ae7-4740-8341-396784dd6c14 1G Sep 06 08:05:59 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:05:59 devstack sudo[91088]: pam_unix(sudo:session): session closed for user root Sep 06 08:05:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.241s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:05:59 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:05:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager._thread_info {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:05:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread count: 8 {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 08:05:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread info: [<_MainThread(MainThread, started 139985167040640)>, , , , , , , ] {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:06:00 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-bc859490-3239-4ede-ab40-0e45522e53b1 req-bbdd6844-0d1f-4ce6-9bfe-a0d680aac1e8 tempest-VolumesSnapshotsTestJSON-1881546682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.62998f58-7ae7-4740-8341-396784dd6c14 1G" returned: 0 in 0.419s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-bc859490-3239-4ede-ab40-0e45522e53b1 req-bbdd6844-0d1f-4ce6-9bfe-a0d680aac1e8 tempest-VolumesSnapshotsTestJSON-1881546682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22981576-4ae8-4853-98a1-83846232d4e3 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.62998f58-7ae7-4740-8341-396784dd6c14 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:00 devstack sudo[91096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22981576-4ae8-4853-98a1-83846232d4e3 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.62998f58-7ae7-4740-8341-396784dd6c14 Sep 06 08:06:00 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:00 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] group_snapshot ef9a6802-0ace-48a6-a60a-1c16e28d5500: deleting Sep 06 08:06:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] group_snapshot ef9a6802-0ace-48a6-a60a-1c16e28d5500: deleting {{(pid=87307) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 06 08:06:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "cinder-quobyte-5443ab19-b31b-4561-9df6-1805a52f6465" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:06:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-5443ab19-b31b-4561-9df6-1805a52f6465" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:06:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "cinder-quobyte-40cd29ca-7da3-4fdf-9945-f3eccf909f91" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:06:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-40cd29ca-7da3-4fdf-9945-f3eccf909f91" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:06:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Deleting offline snapshot 40cd29ca-7da3-4fdf-9945-f3eccf909f91 of volume 5443ab19-b31b-4561-9df6-1805a52f6465 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:06:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] snapshot_file for this snap is: volume-5443ab19-b31b-4561-9df6-1805a52f6465.40cd29ca-7da3-4fdf-9945-f3eccf909f91 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:06:00 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddf5b20-0f81-463d-bcc8-130dc4bd9e01]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.40cd29ca-7da3-4fdf-9945-f3eccf909f91 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:00 devstack sudo[91098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.40cd29ca-7da3-4fdf-9945-f3eccf909f91 Sep 06 08:06:00 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:00 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-bc859490-3239-4ede-ab40-0e45522e53b1 req-bbdd6844-0d1f-4ce6-9bfe-a0d680aac1e8 tempest-VolumesSnapshotsTestJSON-1881546682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22981576-4ae8-4853-98a1-83846232d4e3 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.62998f58-7ae7-4740-8341-396784dd6c14" returned: 0 in 0.375s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:00 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [req-bc859490-3239-4ede-ab40-0e45522e53b1 req-bbdd6844-0d1f-4ce6-9bfe-a0d680aac1e8 tempest-VolumesSnapshotsTestJSON-1881546682 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.62998f58-7ae7-4740-8341-396784dd6c14 is being set with open permissions: ugo+rw Sep 06 08:06:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-bc859490-3239-4ede-ab40-0e45522e53b1 req-bbdd6844-0d1f-4ce6-9bfe-a0d680aac1e8 tempest-VolumesSnapshotsTestJSON-1881546682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.62998f58-7ae7-4740-8341-396784dd6c14 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:00 devstack sudo[91103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.62998f58-7ae7-4740-8341-396784dd6c14 Sep 06 08:06:00 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:00 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.40cd29ca-7da3-4fdf-9945-f3eccf909f91" returned: 0 in 0.380s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5443ab19-b31b-4561-9df6-1805a52f6465(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:06:00 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[960ffc4c-5985-4f76-b2c6-f95e71f63385]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:00 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-bc859490-3239-4ede-ab40-0e45522e53b1 req-bbdd6844-0d1f-4ce6-9bfe-a0d680aac1e8 tempest-VolumesSnapshotsTestJSON-1881546682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.62998f58-7ae7-4740-8341-396784dd6c14" returned: 0 in 0.244s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-bc859490-3239-4ede-ab40-0e45522e53b1 req-bbdd6844-0d1f-4ce6-9bfe-a0d680aac1e8 tempest-VolumesSnapshotsTestJSON-1881546682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:00 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.info Sep 06 08:06:00 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:00 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465 Sep 06 08:06:00 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:01 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-bc859490-3239-4ede-ab40-0e45522e53b1 req-bbdd6844-0d1f-4ce6-9bfe-a0d680aac1e8 tempest-VolumesSnapshotsTestJSON-1881546682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.info" returned: 0 in 0.255s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:01 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [req-bc859490-3239-4ede-ab40-0e45522e53b1 req-bbdd6844-0d1f-4ce6-9bfe-a0d680aac1e8 tempest-VolumesSnapshotsTestJSON-1881546682 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.info is being set with open permissions: ugo+rw Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-bc859490-3239-4ede-ab40-0e45522e53b1 req-bbdd6844-0d1f-4ce6-9bfe-a0d680aac1e8 tempest-VolumesSnapshotsTestJSON-1881546682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:01 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.info Sep 06 08:06:01 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:01 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465" returned: 0 in 0.394s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.40cd29ca-7da3-4fdf-9945-f3eccf909f91 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:01 devstack sudo[91121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.40cd29ca-7da3-4fdf-9945-f3eccf909f91 Sep 06 08:06:01 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:01 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-bc859490-3239-4ede-ab40-0e45522e53b1 req-bbdd6844-0d1f-4ce6-9bfe-a0d680aac1e8 tempest-VolumesSnapshotsTestJSON-1881546682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.info" returned: 0 in 0.253s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-bc859490-3239-4ede-ab40-0e45522e53b1 req-bbdd6844-0d1f-4ce6-9bfe-a0d680aac1e8 tempest-VolumesSnapshotsTestJSON-1881546682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.041s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-7333725b-53bd-4f81-8cf7-3ec00ba5c4ae req-4b625748-714b-473c-99f3-c028cce25608 tempest-ServerActionsTestOtherA-1802890097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.550s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-7333725b-53bd-4f81-8cf7-3ec00ba5c4ae req-4b625748-714b-473c-99f3-c028cce25608 tempest-ServerActionsTestOtherA-1802890097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:01 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-bc859490-3239-4ede-ab40-0e45522e53b1 req-bbdd6844-0d1f-4ce6-9bfe-a0d680aac1e8 tempest-VolumesSnapshotsTestJSON-1881546682 None] Create snapshot completed successfully Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-7333725b-53bd-4f81-8cf7-3ec00ba5c4ae req-4b625748-714b-473c-99f3-c028cce25608 tempest-ServerActionsTestOtherA-1802890097 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0', 'name': 'volume-fffb2711-ccc9-468f-85fa-047d1a562d37', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b052b037-81ab-4203-add4-25702ddd751a', 'enforce_multipath': True} {{(pid=87307) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 08:06:01 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-7333725b-53bd-4f81-8cf7-3ec00ba5c4ae req-4b625748-714b-473c-99f3-c028cce25608 tempest-ServerActionsTestOtherA-1802890097 None] attachment_update completed successfully. Sep 06 08:06:01 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.40cd29ca-7da3-4fdf-9945-f3eccf909f91" returned: 0 in 0.364s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.40cd29ca-7da3-4fdf-9945-f3eccf909f91 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:01 devstack sudo[91129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.40cd29ca-7da3-4fdf-9945-f3eccf909f91 Sep 06 08:06:01 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-08f5a4a3-9138-4269-8271-f496981a8b3a req-ea0eeb90-8cae-4c9f-a5be-892db0a97994 tempest-VolumesSnapshotsTestJSON-1881546682 None] Acquiring lock "cinder-62998f58-7ae7-4740-8341-396784dd6c14-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-08f5a4a3-9138-4269-8271-f496981a8b3a req-ea0eeb90-8cae-4c9f-a5be-892db0a97994 tempest-VolumesSnapshotsTestJSON-1881546682 None] Lock "cinder-62998f58-7ae7-4740-8341-396784dd6c14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-08f5a4a3-9138-4269-8271-f496981a8b3a req-ea0eeb90-8cae-4c9f-a5be-892db0a97994 tempest-VolumesSnapshotsTestJSON-1881546682 None] Acquiring lock "cinder-quobyte-22981576-4ae8-4853-98a1-83846232d4e3" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-08f5a4a3-9138-4269-8271-f496981a8b3a req-ea0eeb90-8cae-4c9f-a5be-892db0a97994 tempest-VolumesSnapshotsTestJSON-1881546682 None] Lock "cinder-quobyte-22981576-4ae8-4853-98a1-83846232d4e3" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-08f5a4a3-9138-4269-8271-f496981a8b3a req-ea0eeb90-8cae-4c9f-a5be-892db0a97994 tempest-VolumesSnapshotsTestJSON-1881546682 None] Acquiring lock "cinder-quobyte-62998f58-7ae7-4740-8341-396784dd6c14" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-08f5a4a3-9138-4269-8271-f496981a8b3a req-ea0eeb90-8cae-4c9f-a5be-892db0a97994 tempest-VolumesSnapshotsTestJSON-1881546682 None] Lock "cinder-quobyte-62998f58-7ae7-4740-8341-396784dd6c14" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [req-08f5a4a3-9138-4269-8271-f496981a8b3a req-ea0eeb90-8cae-4c9f-a5be-892db0a97994 tempest-VolumesSnapshotsTestJSON-1881546682 None] Deleting offline snapshot 62998f58-7ae7-4740-8341-396784dd6c14 of volume 22981576-4ae8-4853-98a1-83846232d4e3 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [req-08f5a4a3-9138-4269-8271-f496981a8b3a req-ea0eeb90-8cae-4c9f-a5be-892db0a97994 tempest-VolumesSnapshotsTestJSON-1881546682 None] snapshot_file for this snap is: volume-22981576-4ae8-4853-98a1-83846232d4e3.62998f58-7ae7-4740-8341-396784dd6c14 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[13be2824-dbce-4e58-b401-aebbe80a7153]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-08f5a4a3-9138-4269-8271-f496981a8b3a req-ea0eeb90-8cae-4c9f-a5be-892db0a97994 tempest-VolumesSnapshotsTestJSON-1881546682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.62998f58-7ae7-4740-8341-396784dd6c14 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:01 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465.40cd29ca-7da3-4fdf-9945-f3eccf909f91" returned: 0 in 0.309s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-40cd29ca-7da3-4fdf-9945-f3eccf909f91" released by "_delete_snapshot" :: held 1.555s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-5443ab19-b31b-4561-9df6-1805a52f6465" released by "delete_snapshot" :: held 1.584s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "cinder-quobyte-360b751e-8a79-4ecb-a880-99a1cc04f24c" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-360b751e-8a79-4ecb-a880-99a1cc04f24c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "cinder-quobyte-48fe9409-fea9-4437-86e5-57feb34d72cb" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-48fe9409-fea9-4437-86e5-57feb34d72cb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Deleting offline snapshot 48fe9409-fea9-4437-86e5-57feb34d72cb of volume 360b751e-8a79-4ecb-a880-99a1cc04f24c {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:06:01 devstack sudo[91511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.62998f58-7ae7-4740-8341-396784dd6c14 Sep 06 08:06:01 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] snapshot_file for this snap is: volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.48fe9409-fea9-4437-86e5-57feb34d72cb {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bad4437-1c23-4f21-8347-d5db77436d56]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.48fe9409-fea9-4437-86e5-57feb34d72cb {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:02 devstack sudo[91515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.48fe9409-fea9-4437-86e5-57feb34d72cb Sep 06 08:06:02 devstack sudo[91515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:02 devstack sudo[91511]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-08f5a4a3-9138-4269-8271-f496981a8b3a req-ea0eeb90-8cae-4c9f-a5be-892db0a97994 tempest-VolumesSnapshotsTestJSON-1881546682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.62998f58-7ae7-4740-8341-396784dd6c14" returned: 0 in 0.432s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:02 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [req-08f5a4a3-9138-4269-8271-f496981a8b3a req-ea0eeb90-8cae-4c9f-a5be-892db0a97994 tempest-VolumesSnapshotsTestJSON-1881546682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22981576-4ae8-4853-98a1-83846232d4e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:06:02 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91670d6-b084-4703-a3ae-48b88c10ceb4]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-08f5a4a3-9138-4269-8271-f496981a8b3a req-ea0eeb90-8cae-4c9f-a5be-892db0a97994 tempest-VolumesSnapshotsTestJSON-1881546682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:02 devstack sudo[91527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3 Sep 06 08:06:02 devstack sudo[91527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:02 devstack sudo[91515]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.48fe9409-fea9-4437-86e5-57feb34d72cb" returned: 0 in 0.464s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:02 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-360b751e-8a79-4ecb-a880-99a1cc04f24c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:06:02 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bfe1da-a4ec-4742-86dd-84f0802279af]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:02 devstack sudo[91532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c Sep 06 08:06:02 devstack sudo[91532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:02 devstack sudo[91527]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-08f5a4a3-9138-4269-8271-f496981a8b3a req-ea0eeb90-8cae-4c9f-a5be-892db0a97994 tempest-VolumesSnapshotsTestJSON-1881546682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3" returned: 0 in 0.397s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-08f5a4a3-9138-4269-8271-f496981a8b3a req-ea0eeb90-8cae-4c9f-a5be-892db0a97994 tempest-VolumesSnapshotsTestJSON-1881546682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.62998f58-7ae7-4740-8341-396784dd6c14 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:02 devstack sudo[91537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.62998f58-7ae7-4740-8341-396784dd6c14 Sep 06 08:06:02 devstack sudo[91537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:02 devstack sudo[91532]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c" returned: 0 in 0.380s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.48fe9409-fea9-4437-86e5-57feb34d72cb {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:02 devstack sudo[91542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.48fe9409-fea9-4437-86e5-57feb34d72cb Sep 06 08:06:02 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:03 devstack sudo[91537]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-08f5a4a3-9138-4269-8271-f496981a8b3a req-ea0eeb90-8cae-4c9f-a5be-892db0a97994 tempest-VolumesSnapshotsTestJSON-1881546682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.62998f58-7ae7-4740-8341-396784dd6c14" returned: 0 in 0.411s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-08f5a4a3-9138-4269-8271-f496981a8b3a req-ea0eeb90-8cae-4c9f-a5be-892db0a97994 tempest-VolumesSnapshotsTestJSON-1881546682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.62998f58-7ae7-4740-8341-396784dd6c14 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:03 devstack sudo[91549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.62998f58-7ae7-4740-8341-396784dd6c14 Sep 06 08:06:03 devstack sudo[91549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:03 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.48fe9409-fea9-4437-86e5-57feb34d72cb" returned: 0 in 0.429s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.48fe9409-fea9-4437-86e5-57feb34d72cb {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:03 devstack sudo[91553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.48fe9409-fea9-4437-86e5-57feb34d72cb Sep 06 08:06:03 devstack sudo[91553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:03 devstack sudo[91549]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-08f5a4a3-9138-4269-8271-f496981a8b3a req-ea0eeb90-8cae-4c9f-a5be-892db0a97994 tempest-VolumesSnapshotsTestJSON-1881546682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3.62998f58-7ae7-4740-8341-396784dd6c14" returned: 0 in 0.272s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-08f5a4a3-9138-4269-8271-f496981a8b3a req-ea0eeb90-8cae-4c9f-a5be-892db0a97994 tempest-VolumesSnapshotsTestJSON-1881546682 None] Lock "cinder-quobyte-62998f58-7ae7-4740-8341-396784dd6c14" released by "_delete_snapshot" :: held 1.637s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:06:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-08f5a4a3-9138-4269-8271-f496981a8b3a req-ea0eeb90-8cae-4c9f-a5be-892db0a97994 tempest-VolumesSnapshotsTestJSON-1881546682 None] Lock "cinder-quobyte-22981576-4ae8-4853-98a1-83846232d4e3" released by "delete_snapshot" :: held 1.668s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:06:03 devstack cinder-volume[87307]: WARNING cinder.quota [req-08f5a4a3-9138-4269-8271-f496981a8b3a req-ea0eeb90-8cae-4c9f-a5be-892db0a97994 tempest-VolumesSnapshotsTestJSON-1881546682 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:06:03 devstack cinder-volume[87307]: DEBUG cinder.quota [req-08f5a4a3-9138-4269-8271-f496981a8b3a req-ea0eeb90-8cae-4c9f-a5be-892db0a97994 tempest-VolumesSnapshotsTestJSON-1881546682 None] Created reservations ['8c27b89d-0c61-4df5-a4ea-85464f8a3be8', 'd25f7a88-b0ce-4a4b-933c-cd8b6bf83b96', '6ac25410-9bea-44c8-b9c5-56d3ff1d4e24', 'dfd131e2-f965-4530-b7a1-511580b63ac8'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:06:03 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-08f5a4a3-9138-4269-8271-f496981a8b3a req-ea0eeb90-8cae-4c9f-a5be-892db0a97994 tempest-VolumesSnapshotsTestJSON-1881546682 None] Delete snapshot completed successfully. Sep 06 08:06:03 devstack sudo[91553]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-08f5a4a3-9138-4269-8271-f496981a8b3a req-ea0eeb90-8cae-4c9f-a5be-892db0a97994 tempest-VolumesSnapshotsTestJSON-1881546682 None] Lock "cinder-62998f58-7ae7-4740-8341-396784dd6c14-delete_snapshot" released by "delete_snapshot" :: held 1.831s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:06:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c.48fe9409-fea9-4437-86e5-57feb34d72cb" returned: 0 in 0.292s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-48fe9409-fea9-4437-86e5-57feb34d72cb" released by "_delete_snapshot" :: held 1.659s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:06:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-360b751e-8a79-4ecb-a880-99a1cc04f24c" released by "delete_snapshot" :: held 1.684s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:06:03 devstack cinder-volume[87307]: WARNING cinder.quota [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-450067408 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-450067408, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:06:03 devstack cinder-volume[87307]: WARNING cinder.quota [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-450067408 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-450067408, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:06:03 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Created reservations ['3aa47721-2c41-434e-88be-dea37e8a05c3', '39af3874-34ca-4a95-ade1-a21357a132da', '4c07c373-1aa8-4972-ad8b-dcbcc637909f', 'f53014dc-776a-4961-9430-93fd67afc31b'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:06:03 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] Created reservations ['6da25687-cce8-419d-aa16-085f6793b7ad', 'd6539d61-c4c3-43c8-9989-5f41c8b49a51', '3c0a587c-338e-46a2-bb5e-e0bab0df8295', '02d44419-93ab-42b5-8e9f-9c169b044b8e'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:06:03 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-0ffe14af-3cd1-47f8-8ff3-df3d327f374b tempest-GroupSnapshotsTest-1472890853 None] group_snapshot ef9a6802-0ace-48a6-a60a-1c16e28d5500: deleted successfully Sep 06 08:06:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-2fdfd6ed-b73a-498c-ad8c-c64fc4fb044b req-1632ae25-2c3c-4a08-87fa-1c6f7c724ed3 tempest-VolumesSnapshotsTestJSON-1881546682 None] Acquiring lock "cinder-22981576-4ae8-4853-98a1-83846232d4e3-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:06:04 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-2fdfd6ed-b73a-498c-ad8c-c64fc4fb044b req-1632ae25-2c3c-4a08-87fa-1c6f7c724ed3 tempest-VolumesSnapshotsTestJSON-1881546682 None] Lock "cinder-22981576-4ae8-4853-98a1-83846232d4e3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:06:04 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-2fdfd6ed-b73a-498c-ad8c-c64fc4fb044b req-1632ae25-2c3c-4a08-87fa-1c6f7c724ed3 tempest-VolumesSnapshotsTestJSON-1881546682 None] Acquiring lock "cinder-quobyte-22981576-4ae8-4853-98a1-83846232d4e3" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:06:04 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-2fdfd6ed-b73a-498c-ad8c-c64fc4fb044b req-1632ae25-2c3c-4a08-87fa-1c6f7c724ed3 tempest-VolumesSnapshotsTestJSON-1881546682 None] Lock "cinder-quobyte-22981576-4ae8-4853-98a1-83846232d4e3" acquired by "delete_volume" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:06:04 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8204d67a-c134-4661-a113-13a002c0bc97]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-2fdfd6ed-b73a-498c-ad8c-c64fc4fb044b req-1632ae25-2c3c-4a08-87fa-1c6f7c724ed3 tempest-VolumesSnapshotsTestJSON-1881546682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:04 devstack sudo[91562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3 Sep 06 08:06:04 devstack sudo[91562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:04 devstack sudo[91562]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-2fdfd6ed-b73a-498c-ad8c-c64fc4fb044b req-1632ae25-2c3c-4a08-87fa-1c6f7c724ed3 tempest-VolumesSnapshotsTestJSON-1881546682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3" returned: 0 in 0.394s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-2fdfd6ed-b73a-498c-ad8c-c64fc4fb044b req-1632ae25-2c3c-4a08-87fa-1c6f7c724ed3 tempest-VolumesSnapshotsTestJSON-1881546682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:04 devstack sudo[91572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3 Sep 06 08:06:04 devstack sudo[91572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:04 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-6280bcdb-0466-40eb-bd8e-1346307094c5 req-6bb27664-870a-4687-9070-a5b51e1ce612 tempest-ServerActionsTestOtherA-1802890097 None] Terminate volume connection completed successfully. Sep 06 08:06:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-6280bcdb-0466-40eb-bd8e-1346307094c5 req-6bb27664-870a-4687-9070-a5b51e1ce612 tempest-ServerActionsTestOtherA-1802890097 None] Deleting attachment b052b037-81ab-4203-add4-25702ddd751a. {{(pid=87307) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 08:06:04 devstack sudo[91572]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-2fdfd6ed-b73a-498c-ad8c-c64fc4fb044b req-1632ae25-2c3c-4a08-87fa-1c6f7c724ed3 tempest-VolumesSnapshotsTestJSON-1881546682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-22981576-4ae8-4853-98a1-83846232d4e3" returned: 0 in 0.311s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:04 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-2fdfd6ed-b73a-498c-ad8c-c64fc4fb044b req-1632ae25-2c3c-4a08-87fa-1c6f7c724ed3 tempest-VolumesSnapshotsTestJSON-1881546682 None] Lock "cinder-quobyte-22981576-4ae8-4853-98a1-83846232d4e3" released by "delete_volume" :: held 0.779s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:06:04 devstack cinder-volume[87307]: DEBUG cinder.quota [req-2fdfd6ed-b73a-498c-ad8c-c64fc4fb044b req-1632ae25-2c3c-4a08-87fa-1c6f7c724ed3 tempest-VolumesSnapshotsTestJSON-1881546682 None] Created reservations ['4771e19d-51bc-4356-ba55-28a7e5daa1ed', '270884bb-524a-4a08-9c36-12d0cb7222b1', 'a4747d20-aef4-4c15-bc6b-57d776f22397', '5b0b3666-1c49-41ea-917c-67822fd61c5b'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:06:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-2fdfd6ed-b73a-498c-ad8c-c64fc4fb044b req-1632ae25-2c3c-4a08-87fa-1c6f7c724ed3 tempest-VolumesSnapshotsTestJSON-1881546682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-2fdfd6ed-b73a-498c-ad8c-c64fc4fb044b req-1632ae25-2c3c-4a08-87fa-1c6f7c724ed3 tempest-VolumesSnapshotsTestJSON-1881546682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:05 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [req-2fdfd6ed-b73a-498c-ad8c-c64fc4fb044b req-1632ae25-2c3c-4a08-87fa-1c6f7c724ed3 tempest-VolumesSnapshotsTestJSON-1881546682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:06:05 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [req-2fdfd6ed-b73a-498c-ad8c-c64fc4fb044b req-1632ae25-2c3c-4a08-87fa-1c6f7c724ed3 tempest-VolumesSnapshotsTestJSON-1881546682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:06:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-2fdfd6ed-b73a-498c-ad8c-c64fc4fb044b req-1632ae25-2c3c-4a08-87fa-1c6f7c724ed3 tempest-VolumesSnapshotsTestJSON-1881546682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-2fdfd6ed-b73a-498c-ad8c-c64fc4fb044b req-1632ae25-2c3c-4a08-87fa-1c6f7c724ed3 tempest-VolumesSnapshotsTestJSON-1881546682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:05 devstack sudo[91615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:06:05 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "cinder-quobyte-360b751e-8a79-4ecb-a880-99a1cc04f24c" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:06:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-360b751e-8a79-4ecb-a880-99a1cc04f24c" acquired by "delete_volume" :: waited 0.045s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:06:05 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a12be86-3b72-447f-b02a-62cb8891c696]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:05 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-2fdfd6ed-b73a-498c-ad8c-c64fc4fb044b req-1632ae25-2c3c-4a08-87fa-1c6f7c724ed3 tempest-VolumesSnapshotsTestJSON-1881546682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.483s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:05 devstack cinder-volume[87307]: DEBUG cinder.manager [req-2fdfd6ed-b73a-498c-ad8c-c64fc4fb044b req-1632ae25-2c3c-4a08-87fa-1c6f7c724ed3 tempest-VolumesSnapshotsTestJSON-1881546682 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:06:05 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-2fdfd6ed-b73a-498c-ad8c-c64fc4fb044b req-1632ae25-2c3c-4a08-87fa-1c6f7c724ed3 tempest-VolumesSnapshotsTestJSON-1881546682 None] Deleted volume successfully. Sep 06 08:06:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-2fdfd6ed-b73a-498c-ad8c-c64fc4fb044b req-1632ae25-2c3c-4a08-87fa-1c6f7c724ed3 tempest-VolumesSnapshotsTestJSON-1881546682 None] Lock "cinder-22981576-4ae8-4853-98a1-83846232d4e3-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:06:05 devstack sudo[91623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c Sep 06 08:06:05 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-6280bcdb-0466-40eb-bd8e-1346307094c5 req-5beadc39-9fc0-4d03-8e6a-0d30c73aeac8 tempest-ServerActionsTestOtherA-1802890097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-6280bcdb-0466-40eb-bd8e-1346307094c5 req-5beadc39-9fc0-4d03-8e6a-0d30c73aeac8 tempest-ServerActionsTestOtherA-1802890097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-6280bcdb-0466-40eb-bd8e-1346307094c5 req-5beadc39-9fc0-4d03-8e6a-0d30c73aeac8 tempest-ServerActionsTestOtherA-1802890097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-6280bcdb-0466-40eb-bd8e-1346307094c5 req-5beadc39-9fc0-4d03-8e6a-0d30c73aeac8 tempest-ServerActionsTestOtherA-1802890097 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0', 'name': 'volume-fffb2711-ccc9-468f-85fa-047d1a562d37', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a465093-e006-428e-bbfa-db5d9ee6ef85', 'enforce_multipath': True} {{(pid=87307) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 08:06:06 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c" returned: 0 in 0.557s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:06 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-6280bcdb-0466-40eb-bd8e-1346307094c5 req-5beadc39-9fc0-4d03-8e6a-0d30c73aeac8 tempest-ServerActionsTestOtherA-1802890097 None] attachment_update completed successfully. Sep 06 08:06:06 devstack sudo[91638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c Sep 06 08:06:06 devstack sudo[91638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:06 devstack sudo[91638]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-360b751e-8a79-4ecb-a880-99a1cc04f24c" returned: 0 in 0.424s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-360b751e-8a79-4ecb-a880-99a1cc04f24c" released by "delete_volume" :: held 1.121s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:06:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "cinder-quobyte-5443ab19-b31b-4561-9df6-1805a52f6465" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:06:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-5443ab19-b31b-4561-9df6-1805a52f6465" acquired by "delete_volume" :: waited 0.024s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:06:06 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f3f815-c24c-4c2c-8b07-ce7375234122]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:06 devstack sudo[91645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465 Sep 06 08:06:06 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:07 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465" returned: 0 in 0.556s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:07 devstack sudo[91660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465 Sep 06 08:06:07 devstack sudo[91660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:07 devstack sudo[91660]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5443ab19-b31b-4561-9df6-1805a52f6465" returned: 0 in 0.317s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:07 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-5443ab19-b31b-4561-9df6-1805a52f6465" released by "delete_volume" :: held 0.964s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:06:07 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] Created reservations ['ba3ef5bc-90cd-444a-bf1a-5b85706ab1ca'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:06:07 devstack cinder-volume[87307]: WARNING cinder.quota [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-450067408 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-450067408, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:06:07 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] Created reservations ['65f3a3a1-9f7b-479d-b09e-b63d11828efd', 'a52c2e99-0792-43c6-adae-cce8693e5c7a', 'a83639a8-ac77-4ffb-95da-d72d35b2a830', '0de4313c-c9e7-4291-9995-8e9f7af364a7'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:06:08 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] Created reservations ['c62d3893-f196-4b17-968e-402b80e49a3a', 'c6c42c6b-4fa5-4b80-8367-dda3d49f9c72', '4dd74d89-2a3f-45c3-a4cc-4059a5acc02c', 'fc6e1cfc-995d-47e6-9849-0d155ff6e2c0'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:06:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:08 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:06:08 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:06:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:08 devstack sudo[92067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:06:08 devstack sudo[92067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:08 devstack sudo[92067]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.477s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:08 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:06:08 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-563807ad-1a2b-4a5e-a301-4ce976334cad tempest-GroupSnapshotsTest-1472890853 None] Delete group completed successfully. Sep 06 08:06:10 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-59bc6ac1-df2f-4bfe-8154-b847f4e230bb tempest-GroupSnapshotsTest-1472890853 None] Group tempest-GroupSnapshotsTest-Group-1235539497: creating Sep 06 08:06:10 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-59bc6ac1-df2f-4bfe-8154-b847f4e230bb tempest-GroupSnapshotsTest-1472890853 None] Group tempest-GroupSnapshotsTest-Group-1235539497: created successfully Sep 06 08:06:10 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-59bc6ac1-df2f-4bfe-8154-b847f4e230bb tempest-GroupSnapshotsTest-1472890853 None] Create group completed successfully. Sep 06 08:06:10 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:06:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Flow 'volume_create_manager' (43df37cb-f10b-47b4-aca1-4f1c6096bbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:06:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a309d2-9aac-4ed6-89d9-c719744b8f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a309d2-9aac-4ed6-89d9-c719744b8f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1847645606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb84fd1-6209-4b5a-b40a-f13e5b302772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c2ea92397c46ec91eb2dcebf9cd1e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:06:11Z,use_quota=True,user_id='0033a4af28c84efc85a423e04d743086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16dff2a-e4dd-4d45-95dd-8c9cd73814c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16dff2a-e4dd-4d45-95dd-8c9cd73814c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afeace78-cdbf-4b8d-9fb9-70bd66276517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afeace78-cdbf-4b8d-9fb9-70bd66276517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fb84fd1-6209-4b5a-b40a-f13e5b302772', 'volume_name': 'volume-6fb84fd1-6209-4b5a-b40a-f13e5b302772', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd24d31d-e901-42bb-a51f-d78b30e2a16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd24d31d-e901-42bb-a51f-d78b30e2a16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56fa806-83af-4abf-be3c-e71689de830e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:10 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Volume 6fb84fd1-6209-4b5a-b40a-f13e5b302772: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fb84fd1-6209-4b5a-b40a-f13e5b302772', 'volume_size': 1} Sep 06 08:06:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1847645606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb84fd1-6209-4b5a-b40a-f13e5b302772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c2ea92397c46ec91eb2dcebf9cd1e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:06:11Z,use_quota=True,user_id='0033a4af28c84efc85a423e04d743086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:06:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Creating volume 6fb84fd1-6209-4b5a-b40a-f13e5b302772 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:06:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:06:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:06:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:06:10 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:06:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6fb84fd1-6209-4b5a-b40a-f13e5b302772 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:10 devstack sudo[92095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6fb84fd1-6209-4b5a-b40a-f13e5b302772 1073741824 Sep 06 08:06:10 devstack sudo[92095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:11 devstack sudo[92095]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6fb84fd1-6209-4b5a-b40a-f13e5b302772 1073741824" returned: 0 in 0.676s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Flow 'volume_create_manager' (d5f100d7-82ae-4431-9115-2c134f2f3be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286144a2-9d0d-4a89-8580-8621905c3a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6fb84fd1-6209-4b5a-b40a-f13e5b302772 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286144a2-9d0d-4a89-8580-8621905c3a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1979290346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee295b3-7ba1-4f63-954d-aa5c6379185e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='02e74a3285ed4033ab495d0d3d310923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:06:11Z,use_quota=True,user_id='6be0595ac2ff41cba0bf7e6a8f635a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a11f5d32-1705-445d-9cfe-0f7c7e7156ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a11f5d32-1705-445d-9cfe-0f7c7e7156ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:11 devstack sudo[92114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6fb84fd1-6209-4b5a-b40a-f13e5b302772 Sep 06 08:06:11 devstack sudo[92114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0d40e9-3ce3-4e7c-b2d4-683eebb7b635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0d40e9-3ce3-4e7c-b2d4-683eebb7b635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bee295b3-7ba1-4f63-954d-aa5c6379185e', 'volume_name': 'volume-bee295b3-7ba1-4f63-954d-aa5c6379185e', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b5b92a-5a4e-4313-8dad-c5c6bdcc6b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b5b92a-5a4e-4313-8dad-c5c6bdcc6b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55cfccc7-f03f-4780-855e-58824692ae2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:11 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Volume bee295b3-7ba1-4f63-954d-aa5c6379185e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bee295b3-7ba1-4f63-954d-aa5c6379185e', 'volume_size': 1} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Flow 'volume_create_manager' (b039b0d6-c4a5-4f08-8f10-a0636a6327a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af097089-db2d-4b4b-8c1e-a514e0867971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af097089-db2d-4b4b-8c1e-a514e0867971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1523013681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4a7f87ab-c757-4cb7-b683-b9f94b16f454,host='devstack@QuobyteHD#QuobyteHD',id=cfdece52-62f3-43c1-9082-ca68a964862b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a4e6cc4e6c4d5da94a7ab201730c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:06:12Z,use_quota=True,user_id='2670d520f5574714be375c35184af357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6335288-52e4-47cd-9e1c-83f799039534),volume_type_id=c6335288-52e4-47cd-9e1c-83f799039534)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bfa7917-2bd0-465b-8937-79e0e33e01e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bfa7917-2bd0-465b-8937-79e0e33e01e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd65cd8e-a339-4384-81c8-4a7a2ab707e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd65cd8e-a339-4384-81c8-4a7a2ab707e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfdece52-62f3-43c1-9082-ca68a964862b', 'volume_name': 'volume-cfdece52-62f3-43c1-9082-ca68a964862b', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da6f8981-6c6d-4209-8713-560d55ab0940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da6f8981-6c6d-4209-8713-560d55ab0940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:11 devstack sudo[92114]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47d28df-fb9c-4fae-a9f2-8eb5f7ce50e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:11 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Volume cfdece52-62f3-43c1-9082-ca68a964862b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfdece52-62f3-43c1-9082-ca68a964862b', 'volume_size': 1} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6fb84fd1-6209-4b5a-b40a-f13e5b302772" returned: 0 in 0.391s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.293s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1979290346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee295b3-7ba1-4f63-954d-aa5c6379185e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='02e74a3285ed4033ab495d0d3d310923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:06:11Z,use_quota=True,user_id='6be0595ac2ff41cba0bf7e6a8f635a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Creating volume bee295b3-7ba1-4f63-954d-aa5c6379185e {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:06:12 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bee295b3-7ba1-4f63-954d-aa5c6379185e 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56fa806-83af-4abf-be3c-e71689de830e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fb84fd1-6209-4b5a-b40a-f13e5b302772', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3db0f8-aa9e-448d-8246-33f623c42a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:12 devstack sudo[92117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bee295b3-7ba1-4f63-954d-aa5c6379185e 1073741824 Sep 06 08:06:12 devstack sudo[92117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:12 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Volume volume-6fb84fd1-6209-4b5a-b40a-f13e5b302772 (6fb84fd1-6209-4b5a-b40a-f13e5b302772): created successfully Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3db0f8-aa9e-448d-8246-33f623c42a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Flow 'volume_create_manager' (43df37cb-f10b-47b4-aca1-4f1c6096bbdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:06:12 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-94cc21e8-e007-45ca-b600-d051e8eb1d5d tempest-AttachVolumeNegativeTest-105042574 None] Created volume successfully. Sep 06 08:06:12 devstack sudo[92117]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bee295b3-7ba1-4f63-954d-aa5c6379185e 1073741824" returned: 0 in 0.529s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bee295b3-7ba1-4f63-954d-aa5c6379185e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:12 devstack sudo[92122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bee295b3-7ba1-4f63-954d-aa5c6379185e Sep 06 08:06:12 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:12 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bee295b3-7ba1-4f63-954d-aa5c6379185e" returned: 0 in 0.269s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.860s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4a7f87ab-c757-4cb7-b683-b9f94b16f454,created_at=2026-09-06T06:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1523013681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4a7f87ab-c757-4cb7-b683-b9f94b16f454,host='devstack@QuobyteHD#QuobyteHD',id=cfdece52-62f3-43c1-9082-ca68a964862b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a4e6cc4e6c4d5da94a7ab201730c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:06:12Z,use_quota=True,user_id='2670d520f5574714be375c35184af357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6335288-52e4-47cd-9e1c-83f799039534),volume_type_id=c6335288-52e4-47cd-9e1c-83f799039534)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Creating volume cfdece52-62f3-43c1-9082-ca68a964862b {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:06:12 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55cfccc7-f03f-4780-855e-58824692ae2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bee295b3-7ba1-4f63-954d-aa5c6379185e', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:12 devstack sudo[92125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b 1073741824 Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa6604e-5cf9-4df2-be4c-b4a0f7a8bdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:12 devstack sudo[92125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:12 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Volume volume-bee295b3-7ba1-4f63-954d-aa5c6379185e (bee295b3-7ba1-4f63-954d-aa5c6379185e): created successfully Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa6604e-5cf9-4df2-be4c-b4a0f7a8bdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Flow 'volume_create_manager' (d5f100d7-82ae-4431-9115-2c134f2f3be6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:06:12 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-6f7bebea-fa48-4fa1-9b88-4fff230ad7ea req-57ca2d70-0b69-4d5e-966e-1ded4833c8f9 tempest-VolumesGetTestJSON-1915428821 None] Created volume successfully. Sep 06 08:06:13 devstack sudo[92125]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b 1073741824" returned: 0 in 0.590s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:13 devstack sudo[92138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b Sep 06 08:06:13 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-b09f9a94-4081-41e2-b78d-b87a063a0906 req-3215fe4a-eff6-48cb-9d25-b84c5641f5c3 tempest-AttachVolumeNegativeTest-105042574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:13 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b" returned: 0 in 0.320s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:06:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-b09f9a94-4081-41e2-b78d-b87a063a0906 req-3215fe4a-eff6-48cb-9d25-b84c5641f5c3 tempest-AttachVolumeNegativeTest-105042574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.122s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47d28df-fb9c-4fae-a9f2-8eb5f7ce50e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfdece52-62f3-43c1-9082-ca68a964862b', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e8b517-2578-4963-84a6-691eb653282b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-b09f9a94-4081-41e2-b78d-b87a063a0906 req-3215fe4a-eff6-48cb-9d25-b84c5641f5c3 tempest-AttachVolumeNegativeTest-105042574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:13 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Volume volume-cfdece52-62f3-43c1-9082-ca68a964862b (cfdece52-62f3-43c1-9082-ca68a964862b): created successfully Sep 06 08:06:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e8b517-2578-4963-84a6-691eb653282b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Flow 'volume_create_manager' (b039b0d6-c4a5-4f08-8f10-a0636a6327a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:06:13 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f963e862-6dc4-443e-9297-99f39e0f5475 tempest-GroupSnapshotsTest-1472890853 None] Created volume successfully. Sep 06 08:06:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-b09f9a94-4081-41e2-b78d-b87a063a0906 req-3215fe4a-eff6-48cb-9d25-b84c5641f5c3 tempest-AttachVolumeNegativeTest-105042574 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0', 'name': 'volume-6fb84fd1-6209-4b5a-b40a-f13e5b302772', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0268e71-3648-4d63-b5fd-fab59ee474ae', 'enforce_multipath': True} {{(pid=87307) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 08:06:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-7adc772f-aa63-4f71-8911-f74e07d3c61a req-2d76a79f-cb02-42fc-8731-192f7bc383db tempest-VolumesGetTestJSON-1915428821 None] Acquiring lock "cinder-bee295b3-7ba1-4f63-954d-aa5c6379185e-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:06:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-7adc772f-aa63-4f71-8911-f74e07d3c61a req-2d76a79f-cb02-42fc-8731-192f7bc383db tempest-VolumesGetTestJSON-1915428821 None] Lock "cinder-bee295b3-7ba1-4f63-954d-aa5c6379185e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:06:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-7adc772f-aa63-4f71-8911-f74e07d3c61a req-2d76a79f-cb02-42fc-8731-192f7bc383db tempest-VolumesGetTestJSON-1915428821 None] Acquiring lock "cinder-quobyte-bee295b3-7ba1-4f63-954d-aa5c6379185e" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:06:14 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-b09f9a94-4081-41e2-b78d-b87a063a0906 req-3215fe4a-eff6-48cb-9d25-b84c5641f5c3 tempest-AttachVolumeNegativeTest-105042574 None] attachment_update completed successfully. Sep 06 08:06:14 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-7adc772f-aa63-4f71-8911-f74e07d3c61a req-2d76a79f-cb02-42fc-8731-192f7bc383db tempest-VolumesGetTestJSON-1915428821 None] Lock "cinder-quobyte-bee295b3-7ba1-4f63-954d-aa5c6379185e" acquired by "delete_volume" :: waited 0.026s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:06:14 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd99d98-629b-4a6a-807e-20b9dc3b10a3]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-7adc772f-aa63-4f71-8911-f74e07d3c61a req-2d76a79f-cb02-42fc-8731-192f7bc383db tempest-VolumesGetTestJSON-1915428821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bee295b3-7ba1-4f63-954d-aa5c6379185e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:14 devstack sudo[92147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bee295b3-7ba1-4f63-954d-aa5c6379185e Sep 06 08:06:14 devstack sudo[92147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:14 devstack sudo[92147]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-7adc772f-aa63-4f71-8911-f74e07d3c61a req-2d76a79f-cb02-42fc-8731-192f7bc383db tempest-VolumesGetTestJSON-1915428821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bee295b3-7ba1-4f63-954d-aa5c6379185e" returned: 0 in 0.545s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-7adc772f-aa63-4f71-8911-f74e07d3c61a req-2d76a79f-cb02-42fc-8731-192f7bc383db tempest-VolumesGetTestJSON-1915428821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bee295b3-7ba1-4f63-954d-aa5c6379185e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:14 devstack sudo[92156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bee295b3-7ba1-4f63-954d-aa5c6379185e Sep 06 08:06:14 devstack sudo[92156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:14 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-27f78661-d225-425f-826f-0d170057a32a tempest-GroupSnapshotsTest-1472890853 None] GroupSnapshot 52b217d5-d65c-42be-b85e-a0033e7a6a6f: creating. Sep 06 08:06:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-27f78661-d225-425f-826f-0d170057a32a tempest-GroupSnapshotsTest-1472890853 None] Group snapshot 52b217d5-d65c-42be-b85e-a0033e7a6a6f: creating. {{(pid=87307) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 06 08:06:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-27f78661-d225-425f-826f-0d170057a32a tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-27f78661-d225-425f-826f-0d170057a32a tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-27f78661-d225-425f-826f-0d170057a32a tempest-GroupSnapshotsTest-1472890853 None] Creating offline snapshot 061399b6-b227-493b-ac20-62296593220b of volume cfdece52-62f3-43c1-9082-ca68a964862b {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:06:14 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dbb4f8-9994-4941-9b87-8a7f7114aa74]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-27f78661-d225-425f-826f-0d170057a32a tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:14 devstack sudo[92156]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-7adc772f-aa63-4f71-8911-f74e07d3c61a req-2d76a79f-cb02-42fc-8731-192f7bc383db tempest-VolumesGetTestJSON-1915428821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bee295b3-7ba1-4f63-954d-aa5c6379185e" returned: 0 in 0.397s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:15 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-7adc772f-aa63-4f71-8911-f74e07d3c61a req-2d76a79f-cb02-42fc-8731-192f7bc383db tempest-VolumesGetTestJSON-1915428821 None] Lock "cinder-quobyte-bee295b3-7ba1-4f63-954d-aa5c6379185e" released by "delete_volume" :: held 0.995s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:06:15 devstack cinder-volume[87307]: DEBUG cinder.quota [req-7adc772f-aa63-4f71-8911-f74e07d3c61a req-2d76a79f-cb02-42fc-8731-192f7bc383db tempest-VolumesGetTestJSON-1915428821 None] Created reservations ['015d66e6-369e-43a7-a3e0-760a80a84625', 'ea644736-fc5f-4ad3-8679-907a5a114e0f', 'e3f0096d-140e-4caa-a209-2a3174df688a', '41ff897c-d303-41a0-8248-6db7a20e375e'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:06:15 devstack sudo[92159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b Sep 06 08:06:15 devstack sudo[92159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-7adc772f-aa63-4f71-8911-f74e07d3c61a req-2d76a79f-cb02-42fc-8731-192f7bc383db tempest-VolumesGetTestJSON-1915428821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-7adc772f-aa63-4f71-8911-f74e07d3c61a req-2d76a79f-cb02-42fc-8731-192f7bc383db tempest-VolumesGetTestJSON-1915428821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:15 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [req-7adc772f-aa63-4f71-8911-f74e07d3c61a req-2d76a79f-cb02-42fc-8731-192f7bc383db tempest-VolumesGetTestJSON-1915428821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:06:15 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [req-7adc772f-aa63-4f71-8911-f74e07d3c61a req-2d76a79f-cb02-42fc-8731-192f7bc383db tempest-VolumesGetTestJSON-1915428821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:06:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-7adc772f-aa63-4f71-8911-f74e07d3c61a req-2d76a79f-cb02-42fc-8731-192f7bc383db tempest-VolumesGetTestJSON-1915428821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-7adc772f-aa63-4f71-8911-f74e07d3c61a req-2d76a79f-cb02-42fc-8731-192f7bc383db tempest-VolumesGetTestJSON-1915428821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:15 devstack sudo[92161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:06:15 devstack sudo[92161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:15 devstack sudo[92161]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-7adc772f-aa63-4f71-8911-f74e07d3c61a req-2d76a79f-cb02-42fc-8731-192f7bc383db tempest-VolumesGetTestJSON-1915428821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.320s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:15 devstack cinder-volume[87307]: DEBUG cinder.manager [req-7adc772f-aa63-4f71-8911-f74e07d3c61a req-2d76a79f-cb02-42fc-8731-192f7bc383db tempest-VolumesGetTestJSON-1915428821 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:06:15 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-7adc772f-aa63-4f71-8911-f74e07d3c61a req-2d76a79f-cb02-42fc-8731-192f7bc383db tempest-VolumesGetTestJSON-1915428821 None] Deleted volume successfully. Sep 06 08:06:15 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-7adc772f-aa63-4f71-8911-f74e07d3c61a req-2d76a79f-cb02-42fc-8731-192f7bc383db tempest-VolumesGetTestJSON-1915428821 None] Lock "cinder-bee295b3-7ba1-4f63-954d-aa5c6379185e-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:06:15 devstack sudo[92159]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-27f78661-d225-425f-826f-0d170057a32a tempest-GroupSnapshotsTest-1472890853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b" returned: 0 in 0.692s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-27f78661-d225-425f-826f-0d170057a32a tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.061399b6-b227-493b-ac20-62296593220b 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:15 devstack sudo[92167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.061399b6-b227-493b-ac20-62296593220b 1G Sep 06 08:06:15 devstack sudo[92167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:16 devstack sudo[92167]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-27f78661-d225-425f-826f-0d170057a32a tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.061399b6-b227-493b-ac20-62296593220b 1G" returned: 0 in 0.510s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-27f78661-d225-425f-826f-0d170057a32a tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfdece52-62f3-43c1-9082-ca68a964862b -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.061399b6-b227-493b-ac20-62296593220b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:16 devstack sudo[92173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfdece52-62f3-43c1-9082-ca68a964862b -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.061399b6-b227-493b-ac20-62296593220b Sep 06 08:06:16 devstack sudo[92173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:16 devstack sudo[92173]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-27f78661-d225-425f-826f-0d170057a32a tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfdece52-62f3-43c1-9082-ca68a964862b -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.061399b6-b227-493b-ac20-62296593220b" returned: 0 in 0.345s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:16 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-27f78661-d225-425f-826f-0d170057a32a tempest-GroupSnapshotsTest-1472890853 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.061399b6-b227-493b-ac20-62296593220b is being set with open permissions: ugo+rw: NotImplementedError Sep 06 08:06:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-27f78661-d225-425f-826f-0d170057a32a tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.061399b6-b227-493b-ac20-62296593220b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:16 devstack sudo[92179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.061399b6-b227-493b-ac20-62296593220b Sep 06 08:06:16 devstack sudo[92179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:16 devstack sudo[92179]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-27f78661-d225-425f-826f-0d170057a32a tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.061399b6-b227-493b-ac20-62296593220b" returned: 0 in 0.296s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-27f78661-d225-425f-826f-0d170057a32a tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:16 devstack sudo[92182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.info Sep 06 08:06:16 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:17 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-27f78661-d225-425f-826f-0d170057a32a tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.info" returned: 0 in 0.358s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:17 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-27f78661-d225-425f-826f-0d170057a32a tempest-GroupSnapshotsTest-1472890853 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 06 08:06:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-27f78661-d225-425f-826f-0d170057a32a tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:17 devstack sudo[92186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.info Sep 06 08:06:17 devstack sudo[92186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:17 devstack sudo[92186]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-27f78661-d225-425f-826f-0d170057a32a tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.info" returned: 0 in 0.299s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-27f78661-d225-425f-826f-0d170057a32a tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.617s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:17 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-27f78661-d225-425f-826f-0d170057a32a tempest-GroupSnapshotsTest-1472890853 None] group_snapshot 52b217d5-d65c-42be-b85e-a0033e7a6a6f: created successfully Sep 06 08:06:18 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-4b4f7c3f-4a55-43da-867d-832b1a789fb8 tempest-GroupSnapshotsTest-1472890853 None] group_snapshot 52b217d5-d65c-42be-b85e-a0033e7a6a6f: deleting Sep 06 08:06:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-4b4f7c3f-4a55-43da-867d-832b1a789fb8 tempest-GroupSnapshotsTest-1472890853 None] group_snapshot 52b217d5-d65c-42be-b85e-a0033e7a6a6f: deleting {{(pid=87307) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 06 08:06:18 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4b4f7c3f-4a55-43da-867d-832b1a789fb8 tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "cinder-quobyte-cfdece52-62f3-43c1-9082-ca68a964862b" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:06:18 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4b4f7c3f-4a55-43da-867d-832b1a789fb8 tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-cfdece52-62f3-43c1-9082-ca68a964862b" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:06:18 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4b4f7c3f-4a55-43da-867d-832b1a789fb8 tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "cinder-quobyte-061399b6-b227-493b-ac20-62296593220b" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:06:18 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4b4f7c3f-4a55-43da-867d-832b1a789fb8 tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-061399b6-b227-493b-ac20-62296593220b" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:06:18 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-4b4f7c3f-4a55-43da-867d-832b1a789fb8 tempest-GroupSnapshotsTest-1472890853 None] Deleting offline snapshot 061399b6-b227-493b-ac20-62296593220b of volume cfdece52-62f3-43c1-9082-ca68a964862b {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:06:18 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-4b4f7c3f-4a55-43da-867d-832b1a789fb8 tempest-GroupSnapshotsTest-1472890853 None] snapshot_file for this snap is: volume-cfdece52-62f3-43c1-9082-ca68a964862b.061399b6-b227-493b-ac20-62296593220b {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:06:18 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d0dd17-9f5f-45e7-af3d-37a539917003]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4b4f7c3f-4a55-43da-867d-832b1a789fb8 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.061399b6-b227-493b-ac20-62296593220b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:18 devstack sudo[92189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.061399b6-b227-493b-ac20-62296593220b Sep 06 08:06:18 devstack sudo[92189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:19 devstack sudo[92189]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4b4f7c3f-4a55-43da-867d-832b1a789fb8 tempest-GroupSnapshotsTest-1472890853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.061399b6-b227-493b-ac20-62296593220b" returned: 0 in 0.490s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-4b4f7c3f-4a55-43da-867d-832b1a789fb8 tempest-GroupSnapshotsTest-1472890853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfdece52-62f3-43c1-9082-ca68a964862b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:06:19 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a75e049-6eb5-4d42-bc0a-e27eda25ca53]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4b4f7c3f-4a55-43da-867d-832b1a789fb8 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:19 devstack sudo[92197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b Sep 06 08:06:19 devstack sudo[92197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:19 devstack sudo[92197]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4b4f7c3f-4a55-43da-867d-832b1a789fb8 tempest-GroupSnapshotsTest-1472890853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b" returned: 0 in 0.478s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4b4f7c3f-4a55-43da-867d-832b1a789fb8 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.061399b6-b227-493b-ac20-62296593220b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:19 devstack sudo[92202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.061399b6-b227-493b-ac20-62296593220b Sep 06 08:06:19 devstack sudo[92202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:20 devstack sudo[92202]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4b4f7c3f-4a55-43da-867d-832b1a789fb8 tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.061399b6-b227-493b-ac20-62296593220b" returned: 0 in 0.550s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4b4f7c3f-4a55-43da-867d-832b1a789fb8 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.061399b6-b227-493b-ac20-62296593220b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:20 devstack sudo[92210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.061399b6-b227-493b-ac20-62296593220b Sep 06 08:06:20 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:20 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4b4f7c3f-4a55-43da-867d-832b1a789fb8 tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b.061399b6-b227-493b-ac20-62296593220b" returned: 0 in 0.429s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:20 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4b4f7c3f-4a55-43da-867d-832b1a789fb8 tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-061399b6-b227-493b-ac20-62296593220b" released by "_delete_snapshot" :: held 2.126s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:06:20 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4b4f7c3f-4a55-43da-867d-832b1a789fb8 tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-cfdece52-62f3-43c1-9082-ca68a964862b" released by "delete_snapshot" :: held 2.179s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:06:20 devstack cinder-volume[87307]: WARNING cinder.quota [None req-4b4f7c3f-4a55-43da-867d-832b1a789fb8 tempest-GroupSnapshotsTest-1472890853 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-460297065 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-460297065, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:06:20 devstack cinder-volume[87307]: WARNING cinder.quota [None req-4b4f7c3f-4a55-43da-867d-832b1a789fb8 tempest-GroupSnapshotsTest-1472890853 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-460297065 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-460297065, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:06:20 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-4b4f7c3f-4a55-43da-867d-832b1a789fb8 tempest-GroupSnapshotsTest-1472890853 None] Created reservations ['86e1eaee-8f6f-475e-8b9c-48fa8e2dda18', '628e81ed-3708-4c91-8f83-fe3ab7375e97', '27f38b81-e52d-461a-ba77-50d39ed91721', '0276c762-8cc5-46d4-a4ca-0416c1d66e99'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:06:20 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-4b4f7c3f-4a55-43da-867d-832b1a789fb8 tempest-GroupSnapshotsTest-1472890853 None] group_snapshot 52b217d5-d65c-42be-b85e-a0033e7a6a6f: deleted successfully Sep 06 08:06:22 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bd549f12-3cdd-4ffa-901a-55eacd9e9573 tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "cinder-quobyte-cfdece52-62f3-43c1-9082-ca68a964862b" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:06:22 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bd549f12-3cdd-4ffa-901a-55eacd9e9573 tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-cfdece52-62f3-43c1-9082-ca68a964862b" acquired by "delete_volume" :: waited 0.023s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:06:22 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f506be2b-678c-4af8-9323-b4e650a3ada0]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bd549f12-3cdd-4ffa-901a-55eacd9e9573 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:22 devstack sudo[92234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b Sep 06 08:06:22 devstack sudo[92234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:22 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-35f609ee-d364-4c0c-afbd-3f53cbb1bace tempest-GroupSnapshotsV319Test-1608458198 None] Group tempest-GroupSnapshotsV319Test-Group-870713797: creating Sep 06 08:06:22 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-35f609ee-d364-4c0c-afbd-3f53cbb1bace tempest-GroupSnapshotsV319Test-1608458198 None] Group tempest-GroupSnapshotsV319Test-Group-870713797: created successfully Sep 06 08:06:22 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-35f609ee-d364-4c0c-afbd-3f53cbb1bace tempest-GroupSnapshotsV319Test-1608458198 None] Create group completed successfully. Sep 06 08:06:22 devstack sudo[92234]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bd549f12-3cdd-4ffa-901a-55eacd9e9573 tempest-GroupSnapshotsTest-1472890853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b" returned: 0 in 0.519s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bd549f12-3cdd-4ffa-901a-55eacd9e9573 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:22 devstack sudo[92257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b Sep 06 08:06:22 devstack sudo[92257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:23 devstack sudo[92257]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bd549f12-3cdd-4ffa-901a-55eacd9e9573 tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cfdece52-62f3-43c1-9082-ca68a964862b" returned: 0 in 0.284s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bd549f12-3cdd-4ffa-901a-55eacd9e9573 tempest-GroupSnapshotsTest-1472890853 None] Lock "cinder-quobyte-cfdece52-62f3-43c1-9082-ca68a964862b" released by "delete_volume" :: held 0.898s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:06:23 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-bd549f12-3cdd-4ffa-901a-55eacd9e9573 tempest-GroupSnapshotsTest-1472890853 None] Created reservations ['090d6698-4c41-45b3-a6ed-2204bf4be67a'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:06:23 devstack cinder-volume[87307]: WARNING cinder.quota [None req-bd549f12-3cdd-4ffa-901a-55eacd9e9573 tempest-GroupSnapshotsTest-1472890853 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-460297065 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-460297065, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:06:23 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-bd549f12-3cdd-4ffa-901a-55eacd9e9573 tempest-GroupSnapshotsTest-1472890853 None] Created reservations ['15d7a708-d3ee-4f10-bb1e-e155d527280c', '0772d060-d91f-4983-a1b5-c3233fdce0e9', '4ba8109b-9712-463e-9df7-d39aab6ffe73', '825d6154-df7b-4bfa-8e24-c7d0dc47e83a'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:06:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bd549f12-3cdd-4ffa-901a-55eacd9e9573 tempest-GroupSnapshotsTest-1472890853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bd549f12-3cdd-4ffa-901a-55eacd9e9573 tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bd549f12-3cdd-4ffa-901a-55eacd9e9573 tempest-GroupSnapshotsTest-1472890853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:06:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bd549f12-3cdd-4ffa-901a-55eacd9e9573 tempest-GroupSnapshotsTest-1472890853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:06:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bd549f12-3cdd-4ffa-901a-55eacd9e9573 tempest-GroupSnapshotsTest-1472890853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bd549f12-3cdd-4ffa-901a-55eacd9e9573 tempest-GroupSnapshotsTest-1472890853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:23 devstack sudo[92262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:06:23 devstack sudo[92262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:23 devstack sudo[92262]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bd549f12-3cdd-4ffa-901a-55eacd9e9573 tempest-GroupSnapshotsTest-1472890853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.273s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:23 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-bd549f12-3cdd-4ffa-901a-55eacd9e9573 tempest-GroupSnapshotsTest-1472890853 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:06:23 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-bd549f12-3cdd-4ffa-901a-55eacd9e9573 tempest-GroupSnapshotsTest-1472890853 None] Delete group completed successfully. Sep 06 08:06:24 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:06:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Flow 'volume_create_manager' (b5d77b7f-c01b-4023-9dce-9952eb6ce47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:06:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df46809-8d49-445b-909d-9380cf7cf775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df46809-8d49-445b-909d-9380cf7cf775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2036515891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=adf17738-2b9f-4a63-84a8-af9a5b4f542e,host='devstack@QuobyteHD#QuobyteHD',id=cd68689a-1278-40b0-91b6-76ab8936373a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2afd2c64c93b4ba6bbb38bfc52c9bea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:06:25Z,use_quota=True,user_id='fa1a52df086a4439bae143fae00d9704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aea8f457-fd37-4666-8527-9aa244e07b52),volume_type_id=aea8f457-fd37-4666-8527-9aa244e07b52)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c087e629-a7ce-42c4-a4ac-ae9cf2d4fd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c087e629-a7ce-42c4-a4ac-ae9cf2d4fd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e78f9478-fe76-4874-9cd9-0697c4628c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e78f9478-fe76-4874-9cd9-0697c4628c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd68689a-1278-40b0-91b6-76ab8936373a', 'volume_name': 'volume-cd68689a-1278-40b0-91b6-76ab8936373a', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab9ef28d-8c69-4c8d-91d0-800072777a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab9ef28d-8c69-4c8d-91d0-800072777a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c220a9b-1ad2-46c2-bbfa-ab708e25b2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:25 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Volume cd68689a-1278-40b0-91b6-76ab8936373a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd68689a-1278-40b0-91b6-76ab8936373a', 'volume_size': 1} Sep 06 08:06:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:25 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=adf17738-2b9f-4a63-84a8-af9a5b4f542e,created_at=2026-09-06T06:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2036515891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=adf17738-2b9f-4a63-84a8-af9a5b4f542e,host='devstack@QuobyteHD#QuobyteHD',id=cd68689a-1278-40b0-91b6-76ab8936373a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2afd2c64c93b4ba6bbb38bfc52c9bea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:06:25Z,use_quota=True,user_id='fa1a52df086a4439bae143fae00d9704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aea8f457-fd37-4666-8527-9aa244e07b52),volume_type_id=aea8f457-fd37-4666-8527-9aa244e07b52)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:06:25 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Creating volume cd68689a-1278-40b0-91b6-76ab8936373a {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:06:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:25 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:06:25 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:06:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:25 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:06:25 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:06:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:25 devstack sudo[92307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a 1073741824 Sep 06 08:06:25 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:25 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a 1073741824" returned: 0 in 0.641s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:25 devstack sudo[92314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a Sep 06 08:06:25 devstack sudo[92314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:26 devstack sudo[92314]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a" returned: 0 in 0.358s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:26 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:06:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c220a9b-1ad2-46c2-bbfa-ab708e25b2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd68689a-1278-40b0-91b6-76ab8936373a', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (589ee3d5-a1a5-4d65-bf82-bda41d4b3b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:26 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Volume volume-cd68689a-1278-40b0-91b6-76ab8936373a (cd68689a-1278-40b0-91b6-76ab8936373a): created successfully Sep 06 08:06:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (589ee3d5-a1a5-4d65-bf82-bda41d4b3b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Flow 'volume_create_manager' (b5d77b7f-c01b-4023-9dce-9952eb6ce47b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:06:26 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-daa429dd-16c0-4939-b5e9-7d8a73236839 tempest-GroupSnapshotsV319Test-1608458198 None] Created volume successfully. Sep 06 08:06:27 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-644200d5-4bed-4878-96a1-0d6d2ade78ca tempest-GroupSnapshotsV319Test-1608458198 None] GroupSnapshot 48da9fcc-1103-4643-94ba-926125069eec: creating. Sep 06 08:06:27 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-644200d5-4bed-4878-96a1-0d6d2ade78ca tempest-GroupSnapshotsV319Test-1608458198 None] Group snapshot 48da9fcc-1103-4643-94ba-926125069eec: creating. {{(pid=87307) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 06 08:06:27 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=153,cinder:UPDATE=148,cinder:INSERT=34,cinder:DELETE=4 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:06:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-644200d5-4bed-4878-96a1-0d6d2ade78ca tempest-GroupSnapshotsV319Test-1608458198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-644200d5-4bed-4878-96a1-0d6d2ade78ca tempest-GroupSnapshotsV319Test-1608458198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:27 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:UPDATE=146,cinder:INSERT=34,cinder:SELECT=155,cinder:DELETE=7 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:06:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-644200d5-4bed-4878-96a1-0d6d2ade78ca tempest-GroupSnapshotsV319Test-1608458198 None] Creating offline snapshot 09edb0be-937e-4584-ab9f-982ad7804ca1 of volume cd68689a-1278-40b0-91b6-76ab8936373a {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:06:27 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[16571974-120b-49bf-9c52-ae9ebeb38900]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-644200d5-4bed-4878-96a1-0d6d2ade78ca tempest-GroupSnapshotsV319Test-1608458198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:28 devstack sudo[92345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a Sep 06 08:06:28 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:28 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-644200d5-4bed-4878-96a1-0d6d2ade78ca tempest-GroupSnapshotsV319Test-1608458198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a" returned: 0 in 0.674s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-644200d5-4bed-4878-96a1-0d6d2ade78ca tempest-GroupSnapshotsV319Test-1608458198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.09edb0be-937e-4584-ab9f-982ad7804ca1 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:28 devstack sudo[92353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.09edb0be-937e-4584-ab9f-982ad7804ca1 1G Sep 06 08:06:28 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:29 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-644200d5-4bed-4878-96a1-0d6d2ade78ca tempest-GroupSnapshotsV319Test-1608458198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.09edb0be-937e-4584-ab9f-982ad7804ca1 1G" returned: 0 in 0.634s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-644200d5-4bed-4878-96a1-0d6d2ade78ca tempest-GroupSnapshotsV319Test-1608458198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd68689a-1278-40b0-91b6-76ab8936373a -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.09edb0be-937e-4584-ab9f-982ad7804ca1 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:29 devstack sudo[92359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd68689a-1278-40b0-91b6-76ab8936373a -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.09edb0be-937e-4584-ab9f-982ad7804ca1 Sep 06 08:06:29 devstack sudo[92359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:29 devstack sudo[92359]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-644200d5-4bed-4878-96a1-0d6d2ade78ca tempest-GroupSnapshotsV319Test-1608458198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd68689a-1278-40b0-91b6-76ab8936373a -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.09edb0be-937e-4584-ab9f-982ad7804ca1" returned: 0 in 0.481s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:29 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-644200d5-4bed-4878-96a1-0d6d2ade78ca tempest-GroupSnapshotsV319Test-1608458198 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.09edb0be-937e-4584-ab9f-982ad7804ca1 is being set with open permissions: ugo+rw: NotImplementedError Sep 06 08:06:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-644200d5-4bed-4878-96a1-0d6d2ade78ca tempest-GroupSnapshotsV319Test-1608458198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.09edb0be-937e-4584-ab9f-982ad7804ca1 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:29 devstack sudo[92364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.09edb0be-937e-4584-ab9f-982ad7804ca1 Sep 06 08:06:29 devstack sudo[92364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:30 devstack sudo[92364]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-644200d5-4bed-4878-96a1-0d6d2ade78ca tempest-GroupSnapshotsV319Test-1608458198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.09edb0be-937e-4584-ab9f-982ad7804ca1" returned: 0 in 0.301s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-644200d5-4bed-4878-96a1-0d6d2ade78ca tempest-GroupSnapshotsV319Test-1608458198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:30 devstack sudo[92367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.info Sep 06 08:06:30 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:30 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-644200d5-4bed-4878-96a1-0d6d2ade78ca tempest-GroupSnapshotsV319Test-1608458198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.info" returned: 0 in 0.324s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:30 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-644200d5-4bed-4878-96a1-0d6d2ade78ca tempest-GroupSnapshotsV319Test-1608458198 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.info is being set with open permissions: ugo+rw: NotImplementedError Sep 06 08:06:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-644200d5-4bed-4878-96a1-0d6d2ade78ca tempest-GroupSnapshotsV319Test-1608458198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:30 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.info Sep 06 08:06:30 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:30 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-644200d5-4bed-4878-96a1-0d6d2ade78ca tempest-GroupSnapshotsV319Test-1608458198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.info" returned: 0 in 0.289s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-644200d5-4bed-4878-96a1-0d6d2ade78ca tempest-GroupSnapshotsV319Test-1608458198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.818s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:30 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-644200d5-4bed-4878-96a1-0d6d2ade78ca tempest-GroupSnapshotsV319Test-1608458198 None] group_snapshot 48da9fcc-1103-4643-94ba-926125069eec: created successfully Sep 06 08:06:31 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-5858953e-0612-4d7d-936f-e1415718e9bc tempest-GroupSnapshotsV319Test-1608458198 None] group_snapshot 48da9fcc-1103-4643-94ba-926125069eec: deleting Sep 06 08:06:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5858953e-0612-4d7d-936f-e1415718e9bc tempest-GroupSnapshotsV319Test-1608458198 None] group_snapshot 48da9fcc-1103-4643-94ba-926125069eec: deleting {{(pid=87307) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 06 08:06:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-5858953e-0612-4d7d-936f-e1415718e9bc tempest-GroupSnapshotsV319Test-1608458198 None] Acquiring lock "cinder-quobyte-cd68689a-1278-40b0-91b6-76ab8936373a" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:06:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-5858953e-0612-4d7d-936f-e1415718e9bc tempest-GroupSnapshotsV319Test-1608458198 None] Lock "cinder-quobyte-cd68689a-1278-40b0-91b6-76ab8936373a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:06:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-5858953e-0612-4d7d-936f-e1415718e9bc tempest-GroupSnapshotsV319Test-1608458198 None] Acquiring lock "cinder-quobyte-09edb0be-937e-4584-ab9f-982ad7804ca1" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:06:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-5858953e-0612-4d7d-936f-e1415718e9bc tempest-GroupSnapshotsV319Test-1608458198 None] Lock "cinder-quobyte-09edb0be-937e-4584-ab9f-982ad7804ca1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:06:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-5858953e-0612-4d7d-936f-e1415718e9bc tempest-GroupSnapshotsV319Test-1608458198 None] Deleting offline snapshot 09edb0be-937e-4584-ab9f-982ad7804ca1 of volume cd68689a-1278-40b0-91b6-76ab8936373a {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:06:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-5858953e-0612-4d7d-936f-e1415718e9bc tempest-GroupSnapshotsV319Test-1608458198 None] snapshot_file for this snap is: volume-cd68689a-1278-40b0-91b6-76ab8936373a.09edb0be-937e-4584-ab9f-982ad7804ca1 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:06:31 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39e741e-ff6c-4e42-b051-2b47d2b031b7]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5858953e-0612-4d7d-936f-e1415718e9bc tempest-GroupSnapshotsV319Test-1608458198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.09edb0be-937e-4584-ab9f-982ad7804ca1 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:31 devstack sudo[92375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.09edb0be-937e-4584-ab9f-982ad7804ca1 Sep 06 08:06:31 devstack sudo[92375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:32 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-1f5641eb-6089-45e4-be9e-3ab4458a0385 tempest-GroupsV314Test-1524333603 None] Group tempest-GroupsV314Test-Group-736673986: creating Sep 06 08:06:32 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-1f5641eb-6089-45e4-be9e-3ab4458a0385 tempest-GroupsV314Test-1524333603 None] Group tempest-GroupsV314Test-Group-736673986: created successfully Sep 06 08:06:32 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-1f5641eb-6089-45e4-be9e-3ab4458a0385 tempest-GroupsV314Test-1524333603 None] Create group completed successfully. Sep 06 08:06:32 devstack sudo[92375]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5858953e-0612-4d7d-936f-e1415718e9bc tempest-GroupSnapshotsV319Test-1608458198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.09edb0be-937e-4584-ab9f-982ad7804ca1" returned: 0 in 0.518s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-5858953e-0612-4d7d-936f-e1415718e9bc tempest-GroupSnapshotsV319Test-1608458198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd68689a-1278-40b0-91b6-76ab8936373a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:06:32 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3fcb87-d3a1-492d-8a4a-085e0c185110]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5858953e-0612-4d7d-936f-e1415718e9bc tempest-GroupSnapshotsV319Test-1608458198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:32 devstack sudo[92381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a Sep 06 08:06:32 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:32 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5858953e-0612-4d7d-936f-e1415718e9bc tempest-GroupSnapshotsV319Test-1608458198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a" returned: 0 in 0.439s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5858953e-0612-4d7d-936f-e1415718e9bc tempest-GroupSnapshotsV319Test-1608458198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.09edb0be-937e-4584-ab9f-982ad7804ca1 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:32 devstack sudo[92387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.09edb0be-937e-4584-ab9f-982ad7804ca1 Sep 06 08:06:32 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:33 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-87320577-8662-467e-b902-e9e470f14d9a req-af1301f8-017c-43d6-a94c-644eb0522bee tempest-ServerActionsTestOtherA-1802890097 None] Terminate volume connection completed successfully. Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-87320577-8662-467e-b902-e9e470f14d9a req-af1301f8-017c-43d6-a94c-644eb0522bee tempest-ServerActionsTestOtherA-1802890097 None] Deleting attachment 6a465093-e006-428e-bbfa-db5d9ee6ef85. {{(pid=87307) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 08:06:33 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5858953e-0612-4d7d-936f-e1415718e9bc tempest-GroupSnapshotsV319Test-1608458198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.09edb0be-937e-4584-ab9f-982ad7804ca1" returned: 0 in 0.453s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5858953e-0612-4d7d-936f-e1415718e9bc tempest-GroupSnapshotsV319Test-1608458198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.09edb0be-937e-4584-ab9f-982ad7804ca1 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:33 devstack sudo[92394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.09edb0be-937e-4584-ab9f-982ad7804ca1 Sep 06 08:06:33 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:33 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5858953e-0612-4d7d-936f-e1415718e9bc tempest-GroupSnapshotsV319Test-1608458198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a.09edb0be-937e-4584-ab9f-982ad7804ca1" returned: 0 in 0.295s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-5858953e-0612-4d7d-936f-e1415718e9bc tempest-GroupSnapshotsV319Test-1608458198 None] Lock "cinder-quobyte-09edb0be-937e-4584-ab9f-982ad7804ca1" released by "_delete_snapshot" :: held 1.838s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-5858953e-0612-4d7d-936f-e1415718e9bc tempest-GroupSnapshotsV319Test-1608458198 None] Lock "cinder-quobyte-cd68689a-1278-40b0-91b6-76ab8936373a" released by "delete_snapshot" :: held 1.881s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:06:33 devstack cinder-volume[87307]: WARNING cinder.quota [None req-5858953e-0612-4d7d-936f-e1415718e9bc tempest-GroupSnapshotsV319Test-1608458198 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1766375477 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1766375477, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:06:33 devstack cinder-volume[87307]: WARNING cinder.quota [None req-5858953e-0612-4d7d-936f-e1415718e9bc tempest-GroupSnapshotsV319Test-1608458198 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1766375477 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1766375477, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-5858953e-0612-4d7d-936f-e1415718e9bc tempest-GroupSnapshotsV319Test-1608458198 None] Created reservations ['5892d161-a970-48d6-bb10-bd30352e157d', '8d78313c-bb25-4df3-9aea-f1fa075623a6', '151a0a7c-015d-481b-9ee5-1e461bd1e99d', '70983552-a9c5-4bdc-bb09-9a021ebd2949'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:06:33 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-5858953e-0612-4d7d-936f-e1415718e9bc tempest-GroupSnapshotsV319Test-1608458198 None] group_snapshot 48da9fcc-1103-4643-94ba-926125069eec: deleted successfully Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Flow 'volume_create_manager' (5819e0fd-d5b1-457f-9772-39d452f6c184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd2b714-b2ea-4206-872a-8a34976f5413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd2b714-b2ea-4206-872a-8a34976f5413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-553854043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d46dc06c-a5c0-4e63-8247-4dc094abf265,host='devstack@QuobyteHD#QuobyteHD',id=f73f229d-7bd9-4095-a37b-2ba7502ef712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf48cce87f14234b36fb51996f44fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:06:34Z,use_quota=True,user_id='885b568a38434c868549705e4a6b753a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfe54aa-65cd-4551-bd8b-472b2cb09181),volume_type_id=bbfe54aa-65cd-4551-bd8b-472b2cb09181)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59cb04de-b9b0-4413-ae6d-4295b0392870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59cb04de-b9b0-4413-ae6d-4295b0392870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cfcdb95-8fed-411f-89ec-5e8ddb78a635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cfcdb95-8fed-411f-89ec-5e8ddb78a635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f73f229d-7bd9-4095-a37b-2ba7502ef712', 'volume_name': 'volume-f73f229d-7bd9-4095-a37b-2ba7502ef712', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047a45e7-b2d5-4d93-9278-4ff53fcc0de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047a45e7-b2d5-4d93-9278-4ff53fcc0de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a7e668-ff48-453a-91b8-5d59ef1c4a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:33 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Volume f73f229d-7bd9-4095-a37b-2ba7502ef712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f73f229d-7bd9-4095-a37b-2ba7502ef712', 'volume_size': 1} Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d46dc06c-a5c0-4e63-8247-4dc094abf265,created_at=2026-09-06T06:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-553854043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d46dc06c-a5c0-4e63-8247-4dc094abf265,host='devstack@QuobyteHD#QuobyteHD',id=f73f229d-7bd9-4095-a37b-2ba7502ef712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf48cce87f14234b36fb51996f44fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:06:34Z,use_quota=True,user_id='885b568a38434c868549705e4a6b753a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfe54aa-65cd-4551-bd8b-472b2cb09181),volume_type_id=bbfe54aa-65cd-4551-bd8b-472b2cb09181)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Creating volume f73f229d-7bd9-4095-a37b-2ba7502ef712 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:06:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:06:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:06:34 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:06:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:34 devstack sudo[92397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712 1073741824 Sep 06 08:06:34 devstack sudo[92397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:34 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6f05d83c-1f59-49dd-a008-4ae5b60a3cdf tempest-GroupSnapshotsV319Test-1608458198 None] Acquiring lock "cinder-quobyte-cd68689a-1278-40b0-91b6-76ab8936373a" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:06:34 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6f05d83c-1f59-49dd-a008-4ae5b60a3cdf tempest-GroupSnapshotsV319Test-1608458198 None] Lock "cinder-quobyte-cd68689a-1278-40b0-91b6-76ab8936373a" acquired by "delete_volume" :: waited 0.031s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:06:34 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f5dc15-3b87-49bc-a0cd-2b8f77a74738]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6f05d83c-1f59-49dd-a008-4ae5b60a3cdf tempest-GroupSnapshotsV319Test-1608458198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:34 devstack sudo[92408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a Sep 06 08:06:34 devstack sudo[92408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:34 devstack sudo[92397]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712 1073741824" returned: 0 in 0.922s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:35 devstack sudo[92427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712 Sep 06 08:06:35 devstack sudo[92427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:35 devstack sudo[92408]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6f05d83c-1f59-49dd-a008-4ae5b60a3cdf tempest-GroupSnapshotsV319Test-1608458198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a" returned: 0 in 0.804s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6f05d83c-1f59-49dd-a008-4ae5b60a3cdf tempest-GroupSnapshotsV319Test-1608458198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:35 devstack sudo[92435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a Sep 06 08:06:35 devstack sudo[92435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:35 devstack sudo[92427]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712" returned: 0 in 0.468s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:06:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a7e668-ff48-453a-91b8-5d59ef1c4a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f73f229d-7bd9-4095-a37b-2ba7502ef712', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d6c8db-b75b-4523-aa55-75d6dfab5d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:35 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Volume volume-f73f229d-7bd9-4095-a37b-2ba7502ef712 (f73f229d-7bd9-4095-a37b-2ba7502ef712): created successfully Sep 06 08:06:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d6c8db-b75b-4523-aa55-75d6dfab5d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Flow 'volume_create_manager' (5819e0fd-d5b1-457f-9772-39d452f6c184) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:06:35 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-492d2a46-8aeb-42bc-b099-3e491c59db02 tempest-GroupsV314Test-1524333603 None] Created volume successfully. Sep 06 08:06:35 devstack sudo[92435]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6f05d83c-1f59-49dd-a008-4ae5b60a3cdf tempest-GroupSnapshotsV319Test-1608458198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd68689a-1278-40b0-91b6-76ab8936373a" returned: 0 in 0.423s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:35 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6f05d83c-1f59-49dd-a008-4ae5b60a3cdf tempest-GroupSnapshotsV319Test-1608458198 None] Lock "cinder-quobyte-cd68689a-1278-40b0-91b6-76ab8936373a" released by "delete_volume" :: held 1.335s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:06:35 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-6f05d83c-1f59-49dd-a008-4ae5b60a3cdf tempest-GroupSnapshotsV319Test-1608458198 None] Created reservations ['ce9061db-e930-47c0-8c18-59e7fa592695'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:06:35 devstack cinder-volume[87307]: WARNING cinder.quota [None req-6f05d83c-1f59-49dd-a008-4ae5b60a3cdf tempest-GroupSnapshotsV319Test-1608458198 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1766375477 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1766375477, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:06:35 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-6f05d83c-1f59-49dd-a008-4ae5b60a3cdf tempest-GroupSnapshotsV319Test-1608458198 None] Created reservations ['f579733e-2be2-4f89-b756-0061fbb833db', '6de61195-b2da-43a2-9617-0f47c008760d', '75ed1ab1-7c5a-41e8-8d75-7d46200be779', '0ce99f26-3532-4b7d-a869-460959304c9b'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:06:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6f05d83c-1f59-49dd-a008-4ae5b60a3cdf tempest-GroupSnapshotsV319Test-1608458198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6f05d83c-1f59-49dd-a008-4ae5b60a3cdf tempest-GroupSnapshotsV319Test-1608458198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:36 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6f05d83c-1f59-49dd-a008-4ae5b60a3cdf tempest-GroupSnapshotsV319Test-1608458198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:06:36 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6f05d83c-1f59-49dd-a008-4ae5b60a3cdf tempest-GroupSnapshotsV319Test-1608458198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:06:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6f05d83c-1f59-49dd-a008-4ae5b60a3cdf tempest-GroupSnapshotsV319Test-1608458198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6f05d83c-1f59-49dd-a008-4ae5b60a3cdf tempest-GroupSnapshotsV319Test-1608458198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:36 devstack sudo[92439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:06:36 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:36 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6f05d83c-1f59-49dd-a008-4ae5b60a3cdf tempest-GroupSnapshotsV319Test-1608458198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.267s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:36 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6f05d83c-1f59-49dd-a008-4ae5b60a3cdf tempest-GroupSnapshotsV319Test-1608458198 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:06:36 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-6f05d83c-1f59-49dd-a008-4ae5b60a3cdf tempest-GroupSnapshotsV319Test-1608458198 None] Delete group completed successfully. Sep 06 08:06:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:37 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Cloning volume f73f229d-7bd9-4095-a37b-2ba7502ef712 to volume 8b3d66ce-444e-4cda-9f3b-c87c3579a22f Sep 06 08:06:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Creating offline snapshot 1d0a35df-8415-4dba-9d1a-baf6e6e9dd25 of volume f73f229d-7bd9-4095-a37b-2ba7502ef712 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:06:37 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6165b44f-adfc-4c02-bccb-03112f57ae09]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:37 devstack sudo[92447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712 Sep 06 08:06:37 devstack sudo[92447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:37 devstack sudo[92447]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712" returned: 0 in 0.479s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.1d0a35df-8415-4dba-9d1a-baf6e6e9dd25 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:38 devstack sudo[92452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.1d0a35df-8415-4dba-9d1a-baf6e6e9dd25 1G Sep 06 08:06:38 devstack sudo[92452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:38 devstack sudo[92452]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.1d0a35df-8415-4dba-9d1a-baf6e6e9dd25 1G" returned: 0 in 0.507s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f73f229d-7bd9-4095-a37b-2ba7502ef712 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.1d0a35df-8415-4dba-9d1a-baf6e6e9dd25 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:38 devstack sudo[92458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f73f229d-7bd9-4095-a37b-2ba7502ef712 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.1d0a35df-8415-4dba-9d1a-baf6e6e9dd25 Sep 06 08:06:38 devstack sudo[92458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:38 devstack sudo[92458]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f73f229d-7bd9-4095-a37b-2ba7502ef712 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.1d0a35df-8415-4dba-9d1a-baf6e6e9dd25" returned: 0 in 0.410s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:38 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.1d0a35df-8415-4dba-9d1a-baf6e6e9dd25 is being set with open permissions: ugo+rw: NotImplementedError Sep 06 08:06:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.1d0a35df-8415-4dba-9d1a-baf6e6e9dd25 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:38 devstack sudo[92464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.1d0a35df-8415-4dba-9d1a-baf6e6e9dd25 Sep 06 08:06:38 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:39 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.1d0a35df-8415-4dba-9d1a-baf6e6e9dd25" returned: 0 in 0.556s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:39 devstack sudo[92517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.info Sep 06 08:06:39 devstack sudo[92517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:39 devstack sudo[92517]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.info" returned: 0 in 0.284s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:39 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.info is being set with open permissions: ugo+rw: NotImplementedError Sep 06 08:06:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:39 devstack sudo[92522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.info Sep 06 08:06:39 devstack sudo[92522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:40 devstack sudo[92522]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.info" returned: 0 in 0.259s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Acquiring lock "cinder-quobyte-8b3d66ce-444e-4cda-9f3b-c87c3579a22f" by "_copy_volume_from_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:06:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Lock "cinder-quobyte-8b3d66ce-444e-4cda-9f3b-c87c3579a22f" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:06:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] snapshot: 1d0a35df-8415-4dba-9d1a-baf6e6e9dd25, volume: 8b3d66ce-444e-4cda-9f3b-c87c3579a22f, {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 06 08:06:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:06:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:06:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:40 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef713e9-55c7-4824-b46d-bbaf4690d246]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.1d0a35df-8415-4dba-9d1a-baf6e6e9dd25 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:40 devstack sudo[92525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.1d0a35df-8415-4dba-9d1a-baf6e6e9dd25 Sep 06 08:06:40 devstack sudo[92525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:40 devstack sudo[92525]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.1d0a35df-8415-4dba-9d1a-baf6e6e9dd25" returned: 0 in 0.448s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f73f229d-7bd9-4095-a37b-2ba7502ef712(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:06:40 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21c9f11-79e0-4137-8d7e-37dce1d6cb91]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:40 devstack sudo[92531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712 Sep 06 08:06:40 devstack sudo[92531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:41 devstack sudo[92531]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712" returned: 0 in 0.416s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] will copy from snapshot at /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712 {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 06 08:06:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Creating direct copy from snapshot {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 06 08:06:41 devstack cinder-volume[87307]: DEBUG cinder.utils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Path /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8b3d66ce-444e-4cda-9f3b-c87c3579a22f not found in is_blk_device check {{(pid=87307) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 06 08:06:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8b3d66ce-444e-4cda-9f3b-c87c3579a22f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:41 devstack sudo[92536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8b3d66ce-444e-4cda-9f3b-c87c3579a22f Sep 06 08:06:41 devstack sudo[92536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:41 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:06:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Flow 'volume_create_manager' (0d514ba9-d485-453c-b544-b5bafd894928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:06:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de6ba7d9-4f0c-4ffc-83f7-9ef22632e0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de6ba7d9-4f0c-4ffc-83f7-9ef22632e0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1235026537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3770341499244c44a72453503d965656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:06:42Z,use_quota=True,user_id='e515cc44e4ba46dc9af422b926914b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4d179e-fa72-47c8-a467-384b8d4f1030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4d179e-fa72-47c8-a467-384b8d4f1030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2434fab1-dc8d-4f34-836d-e23c8106ef8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:42 devstack cinder-volume[87307]: DEBUG cinder.image.glance [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Creating Keystone auth plugin from conf {{(pid=87307) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 08:06:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2434fab1-dc8d-4f34-836d-e23c8106ef8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b', 'volume_name': 'volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b', 'volume_size': 1, 'image_id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1531709cfd9f41a0b45e9cae3f8241b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'created_at': datetime.datetime(2026, 9, 6, 5, 57, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 5, 57, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0548b151-5408-4978-8128-12193afb8300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0548b151-5408-4978-8128-12193afb8300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8607b39c-40fd-46ae-a2bf-9e417e7927ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:45 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Volume 69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b', 'volume_size': 1, 'image_id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1531709cfd9f41a0b45e9cae3f8241b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'created_at': datetime.datetime(2026, 9, 6, 5, 57, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 5, 57, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 06 08:06:45 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Trying to clone 69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b from image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}]). {{(pid=87307) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 08:06:45 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_imx761hedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 08:06:45 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Image download 20.69 MB at 20.69 MB/s Sep 06 08:06:45 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9724052-0d7f-4fa5-8f6d-6391d06db429]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_imx761hedevstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:46 devstack sudo[92573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_imx761hedevstack@QuobyteHD Sep 06 08:06:46 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:46 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_imx761hedevstack@QuobyteHD" returned: 0 in 0.622s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:46 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Temporary image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 is fetched for user e515cc44e4ba46dc9af422b926914b9f. {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 08:06:46 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2da3da-db4c-4794-948b-92af996021e6]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_imx761hedevstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:46 devstack sudo[92536]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8b3d66ce-444e-4cda-9f3b-c87c3579a22f" returned: 0 in 5.803s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:46 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Image conversion details: src /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8b3d66ce-444e-4cda-9f3b-c87c3579a22f {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:06:46 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Converted 1024.00 MB image at 176.41 MB/s Sep 06 08:06:46 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8b3d66ce-444e-4cda-9f3b-c87c3579a22f is being set with open permissions: ugo+rw: NotImplementedError Sep 06 08:06:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8b3d66ce-444e-4cda-9f3b-c87c3579a22f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:46 devstack sudo[92579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_imx761hedevstack@QuobyteHD Sep 06 08:06:46 devstack sudo[92579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:46 devstack sudo[92580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8b3d66ce-444e-4cda-9f3b-c87c3579a22f Sep 06 08:06:46 devstack sudo[92580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:47 devstack sudo[92579]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_imx761hedevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:47 devstack sudo[92580]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8b3d66ce-444e-4cda-9f3b-c87c3579a22f" returned: 0 in 0.341s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Lock "cinder-quobyte-8b3d66ce-444e-4cda-9f3b-c87c3579a22f" released by "_copy_volume_from_snapshot" :: held 7.097s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:06:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Acquiring lock "cinder-quobyte-1d0a35df-8415-4dba-9d1a-baf6e6e9dd25" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:06:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Lock "cinder-quobyte-1d0a35df-8415-4dba-9d1a-baf6e6e9dd25" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:06:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Deleting offline snapshot 1d0a35df-8415-4dba-9d1a-baf6e6e9dd25 of volume f73f229d-7bd9-4095-a37b-2ba7502ef712 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:06:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] snapshot_file for this snap is: volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.1d0a35df-8415-4dba-9d1a-baf6e6e9dd25 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:06:47 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb0f863-f806-45e5-9fff-42dc2b22030d]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.1d0a35df-8415-4dba-9d1a-baf6e6e9dd25 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:47 devstack sudo[92587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.1d0a35df-8415-4dba-9d1a-baf6e6e9dd25 Sep 06 08:06:47 devstack sudo[92587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:47 devstack sudo[92587]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.1d0a35df-8415-4dba-9d1a-baf6e6e9dd25" returned: 0 in 0.446s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f73f229d-7bd9-4095-a37b-2ba7502ef712(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:06:47 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d33c40-9df8-4f04-801e-0ab1002ca7e4]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:47 devstack sudo[92594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712 Sep 06 08:06:47 devstack sudo[92594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:48 devstack sudo[92594]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712" returned: 0 in 0.559s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.1d0a35df-8415-4dba-9d1a-baf6e6e9dd25 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:48 devstack sudo[92599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.1d0a35df-8415-4dba-9d1a-baf6e6e9dd25 Sep 06 08:06:48 devstack sudo[92599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:48 devstack sudo[92599]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.1d0a35df-8415-4dba-9d1a-baf6e6e9dd25" returned: 0 in 0.429s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.1d0a35df-8415-4dba-9d1a-baf6e6e9dd25 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:48 devstack sudo[92605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.1d0a35df-8415-4dba-9d1a-baf6e6e9dd25 Sep 06 08:06:48 devstack sudo[92605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:49 devstack sudo[92605]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712.1d0a35df-8415-4dba-9d1a-baf6e6e9dd25" returned: 0 in 0.293s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:49 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Lock "cinder-quobyte-1d0a35df-8415-4dba-9d1a-baf6e6e9dd25" released by "_delete_snapshot" :: held 1.867s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:06:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.821s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.990s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:49 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1235026537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3770341499244c44a72453503d965656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:06:42Z,use_quota=True,user_id='e515cc44e4ba46dc9af422b926914b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:06:49 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Creating volume 69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:06:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:49 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:06:49 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:06:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:49 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:06:49 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:06:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:49 devstack sudo[92608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b 1073741824 Sep 06 08:06:49 devstack sudo[92608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:49 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f7153c95-80ad-4417-b312-74f672979ab5 tempest-GroupsV314Test-1524333603 None] Create group from source-group-d46dc06c-a5c0-4e63-8247-4dc094abf265 completed successfully. Sep 06 08:06:49 devstack sudo[92608]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b 1073741824" returned: 0 in 0.627s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:49 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b Sep 06 08:06:49 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:50 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b" returned: 0 in 0.308s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:50 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:06:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:50 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Attempting download of 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}])) to volume 69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b. {{(pid=87307) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 08:06:50 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfd9cf7-eb9e-4fd5-bec2-340142acd484]: (4, 'raw') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_hldlbjia {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:50 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-fcd58b61-67e7-40a8-97a2-f6951e25f38c tempest-GroupsV314Test-1524333603 None] Acquiring lock "cinder-quobyte-8b3d66ce-444e-4cda-9f3b-c87c3579a22f" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:06:50 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-fcd58b61-67e7-40a8-97a2-f6951e25f38c tempest-GroupsV314Test-1524333603 None] Lock "cinder-quobyte-8b3d66ce-444e-4cda-9f3b-c87c3579a22f" acquired by "delete_volume" :: waited 0.021s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:06:50 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e29cc4-391a-4270-af5a-3f5cde5c7384]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-fcd58b61-67e7-40a8-97a2-f6951e25f38c tempest-GroupsV314Test-1524333603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8b3d66ce-444e-4cda-9f3b-c87c3579a22f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:50 devstack sudo[92617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_hldlbjia Sep 06 08:06:50 devstack sudo[92617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:50 devstack sudo[92620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8b3d66ce-444e-4cda-9f3b-c87c3579a22f Sep 06 08:06:50 devstack sudo[92620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:50 devstack sudo[92617]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_hldlbjia" returned: 0 in 0.447s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_hldlbjia {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:50 devstack sudo[92625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_hldlbjia Sep 06 08:06:50 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:50 devstack sudo[92620]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-fcd58b61-67e7-40a8-97a2-f6951e25f38c tempest-GroupsV314Test-1524333603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8b3d66ce-444e-4cda-9f3b-c87c3579a22f" returned: 0 in 0.538s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-fcd58b61-67e7-40a8-97a2-f6951e25f38c tempest-GroupsV314Test-1524333603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8b3d66ce-444e-4cda-9f3b-c87c3579a22f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:51 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8b3d66ce-444e-4cda-9f3b-c87c3579a22f Sep 06 08:06:51 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:51 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_hldlbjia" returned: 1 in 0.440s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_hldlbjia' failed. Not Retrying. {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 08:06:51 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd19df6f-df55-458f-8ca1-1a696f4b65c2]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_imx761hedevstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:51 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-fcd58b61-67e7-40a8-97a2-f6951e25f38c tempest-GroupsV314Test-1524333603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8b3d66ce-444e-4cda-9f3b-c87c3579a22f" returned: 0 in 0.325s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:51 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-fcd58b61-67e7-40a8-97a2-f6951e25f38c tempest-GroupsV314Test-1524333603 None] Lock "cinder-quobyte-8b3d66ce-444e-4cda-9f3b-c87c3579a22f" released by "delete_volume" :: held 0.938s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:06:51 devstack sudo[92637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_imx761hedevstack@QuobyteHD Sep 06 08:06:51 devstack sudo[92637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:51 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-fcd58b61-67e7-40a8-97a2-f6951e25f38c tempest-GroupsV314Test-1524333603 None] Created reservations ['d7980b94-d884-4994-b763-92d817c6f8ee'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:06:51 devstack cinder-volume[87307]: WARNING cinder.quota [None req-fcd58b61-67e7-40a8-97a2-f6951e25f38c tempest-GroupsV314Test-1524333603 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-608655285 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-608655285, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:06:51 devstack cinder-volume[87307]: WARNING cinder.quota [None req-fcd58b61-67e7-40a8-97a2-f6951e25f38c tempest-GroupsV314Test-1524333603 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-608655285 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-608655285, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:06:51 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-fcd58b61-67e7-40a8-97a2-f6951e25f38c tempest-GroupsV314Test-1524333603 None] Created reservations ['50f9abab-f574-47ef-9dc1-18ab28e135e3', '77cd8ee3-45ca-495c-9ad2-03f33cbdad5a', '8806ead3-78b3-4daa-ba1e-86a0d62cfeb1', '56940cbe-36cb-4d98-bf18-9f9d31e78464'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:06:51 devstack sudo[92637]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_imx761hedevstack@QuobyteHD" returned: 0 in 0.623s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:51 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 was qcow2, converting to qcow2 {{(pid=87307) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 08:06:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_imx761hedevstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:51 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_imx761hedevstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b Sep 06 08:06:51 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-fcd58b61-67e7-40a8-97a2-f6951e25f38c tempest-GroupsV314Test-1524333603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-fcd58b61-67e7-40a8-97a2-f6951e25f38c tempest-GroupsV314Test-1524333603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-fcd58b61-67e7-40a8-97a2-f6951e25f38c tempest-GroupsV314Test-1524333603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:06:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-fcd58b61-67e7-40a8-97a2-f6951e25f38c tempest-GroupsV314Test-1524333603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:06:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-fcd58b61-67e7-40a8-97a2-f6951e25f38c tempest-GroupsV314Test-1524333603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-fcd58b61-67e7-40a8-97a2-f6951e25f38c tempest-GroupsV314Test-1524333603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:51 devstack sudo[92667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:06:51 devstack sudo[92667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:52 devstack sudo[92667]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-fcd58b61-67e7-40a8-97a2-f6951e25f38c tempest-GroupsV314Test-1524333603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.332s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:52 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-fcd58b61-67e7-40a8-97a2-f6951e25f38c tempest-GroupsV314Test-1524333603 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:06:52 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-fcd58b61-67e7-40a8-97a2-f6951e25f38c tempest-GroupsV314Test-1524333603 None] Delete group completed successfully. Sep 06 08:06:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4c669640-d4c6-41da-8351-9923b3088e23 tempest-GroupsV314Test-1524333603 None] Acquiring lock "cinder-quobyte-f73f229d-7bd9-4095-a37b-2ba7502ef712" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:06:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4c669640-d4c6-41da-8351-9923b3088e23 tempest-GroupsV314Test-1524333603 None] Lock "cinder-quobyte-f73f229d-7bd9-4095-a37b-2ba7502ef712" acquired by "delete_volume" :: waited 0.026s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:06:53 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cfbca0-aa58-4757-88f6-adffe6aabd6f]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:06:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4c669640-d4c6-41da-8351-9923b3088e23 tempest-GroupsV314Test-1524333603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:53 devstack sudo[92682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712 Sep 06 08:06:53 devstack sudo[92682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:54 devstack sudo[92682]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4c669640-d4c6-41da-8351-9923b3088e23 tempest-GroupsV314Test-1524333603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712" returned: 0 in 0.687s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4c669640-d4c6-41da-8351-9923b3088e23 tempest-GroupsV314Test-1524333603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:54 devstack sudo[92689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712 Sep 06 08:06:54 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:54 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4c669640-d4c6-41da-8351-9923b3088e23 tempest-GroupsV314Test-1524333603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f73f229d-7bd9-4095-a37b-2ba7502ef712" returned: 0 in 0.309s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4c669640-d4c6-41da-8351-9923b3088e23 tempest-GroupsV314Test-1524333603 None] Lock "cinder-quobyte-f73f229d-7bd9-4095-a37b-2ba7502ef712" released by "delete_volume" :: held 1.085s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:06:54 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_imx761hedevstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b" returned: 0 in 2.610s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:54 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_imx761hedevstack@QuobyteHD, size 112.00 MB, duration 2.61 sec, destination /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:06:54 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Converted 112.00 MB image at 42.90 MB/s Sep 06 08:06:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:54 devstack sudo[92693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b 1G Sep 06 08:06:54 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:54 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-4c669640-d4c6-41da-8351-9923b3088e23 tempest-GroupsV314Test-1524333603 None] Created reservations ['2603503a-4b5e-4493-b17d-691ca68259d5'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:06:54 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-4c669640-d4c6-41da-8351-9923b3088e23 tempest-GroupsV314Test-1524333603 None] Created reservations ['3d7a6bfc-73ea-4056-bee3-9bfb18b867af', '581e7141-5379-4518-908f-ccf0949dda4c', '6606f164-957c-46e1-b608-3c41ab2175a8', '3160d516-7cd7-4d72-8e8d-237a7814f781'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:06:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-4c669640-d4c6-41da-8351-9923b3088e23 tempest-GroupsV314Test-1524333603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-4c669640-d4c6-41da-8351-9923b3088e23 tempest-GroupsV314Test-1524333603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-4c669640-d4c6-41da-8351-9923b3088e23 tempest-GroupsV314Test-1524333603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:06:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-4c669640-d4c6-41da-8351-9923b3088e23 tempest-GroupsV314Test-1524333603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:06:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-4c669640-d4c6-41da-8351-9923b3088e23 tempest-GroupsV314Test-1524333603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4c669640-d4c6-41da-8351-9923b3088e23 tempest-GroupsV314Test-1524333603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:54 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b 1G" returned: 0 in 0.479s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:54 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Downloaded image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}])) to volume 69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b successfully. {{(pid=87307) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 08:06:54 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Temporary image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 for user e515cc44e4ba46dc9af422b926914b9f is deleted. {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 08:06:54 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Marking volume 69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b as bootable. {{(pid=87307) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 08:06:54 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:06:54 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:06:54 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Copying metadata from image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 to 69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b. {{(pid=87307) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 08:06:54 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Creating volume glance metadata for volume 69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b backed by image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87307) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 08:06:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8607b39c-40fd-46ae-a2bf-9e417e7927ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b', 'volume_size': 1, 'image_id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1531709cfd9f41a0b45e9cae3f8241b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'created_at': datetime.datetime(2026, 9, 6, 5, 57, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 5, 57, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (916e3ee6-c2ba-4de8-b7fc-bc686922d319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:06:55 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Volume volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b (69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b): created successfully Sep 06 08:06:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (916e3ee6-c2ba-4de8-b7fc-bc686922d319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:06:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Flow 'volume_create_manager' (0d514ba9-d485-453c-b544-b5bafd894928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:06:55 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-3da38f10-5692-4b5a-b86b-bcbca4513064 tempest-ServerActionsTestOtherA-1802890097 None] Created volume successfully. Sep 06 08:06:55 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Sep 06 08:06:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4c669640-d4c6-41da-8351-9923b3088e23 tempest-GroupsV314Test-1524333603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.424s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:06:55 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-4c669640-d4c6-41da-8351-9923b3088e23 tempest-GroupsV314Test-1524333603 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:06:55 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-4c669640-d4c6-41da-8351-9923b3088e23 tempest-GroupsV314Test-1524333603 None] Delete group completed successfully. Sep 06 08:06:57 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-49f36024-5555-4c71-b17b-db8d33ce60c1 req-611bf39a-69f0-49f4-8eb3-950db1142c7d tempest-AttachVolumeNegativeTest-105042574 None] Terminate volume connection completed successfully. Sep 06 08:06:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-49f36024-5555-4c71-b17b-db8d33ce60c1 req-611bf39a-69f0-49f4-8eb3-950db1142c7d tempest-AttachVolumeNegativeTest-105042574 None] Deleting attachment b0268e71-3648-4d63-b5fd-fab59ee474ae. {{(pid=87307) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 08:06:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:06:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:06:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:06:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:06:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:06:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:06:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:06:59 devstack sudo[92754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:06:59 devstack sudo[92754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-6e0da11c-2d16-408c-b402-3a4a8c5ee101 req-8908f4dd-7536-4f06-8553-a74f4393ab1e tempest-ServerActionsTestOtherA-1802890097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:07:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-6e0da11c-2d16-408c-b402-3a4a8c5ee101 req-8908f4dd-7536-4f06-8553-a74f4393ab1e tempest-ServerActionsTestOtherA-1802890097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:07:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-6e0da11c-2d16-408c-b402-3a4a8c5ee101 req-8908f4dd-7536-4f06-8553-a74f4393ab1e tempest-ServerActionsTestOtherA-1802890097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:07:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-6e0da11c-2d16-408c-b402-3a4a8c5ee101 req-8908f4dd-7536-4f06-8553-a74f4393ab1e tempest-ServerActionsTestOtherA-1802890097 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0', 'name': 'volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c7373ac-bb2e-4dbd-96f7-9c7afbf08f97', 'enforce_multipath': True} {{(pid=87307) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 08:07:00 devstack sudo[92754]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.461s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:00 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:07:00 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager._thread_info {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:07:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread count: 28 {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 08:07:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread info: [<_MainThread(MainThread, started 139985167040640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:07:00 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-6e0da11c-2d16-408c-b402-3a4a8c5ee101 req-8908f4dd-7536-4f06-8553-a74f4393ab1e tempest-ServerActionsTestOtherA-1802890097 None] attachment_update completed successfully. Sep 06 08:07:06 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-c7443f18-1fd8-4ea1-89b1-c59a6fb88698 tempest-GroupsV320Test-2006236285 None] Group tempest-GroupsV320Test-Group-404854633: creating Sep 06 08:07:06 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-c7443f18-1fd8-4ea1-89b1-c59a6fb88698 tempest-GroupsV320Test-2006236285 None] Group tempest-GroupsV320Test-Group-404854633: created successfully Sep 06 08:07:06 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-c7443f18-1fd8-4ea1-89b1-c59a6fb88698 tempest-GroupsV320Test-2006236285 None] Create group completed successfully. Sep 06 08:07:08 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-312d2329-7058-42f1-bef9-633eeb6cb1f6 tempest-GroupsV320Test-2006236285 None] Created reservations ['1f61772a-332c-4f53-a682-274f46ee20c0'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:07:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-312d2329-7058-42f1-bef9-633eeb6cb1f6 tempest-GroupsV320Test-2006236285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:07:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-312d2329-7058-42f1-bef9-633eeb6cb1f6 tempest-GroupsV320Test-2006236285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:07:08 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-312d2329-7058-42f1-bef9-633eeb6cb1f6 tempest-GroupsV320Test-2006236285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:07:08 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-312d2329-7058-42f1-bef9-633eeb6cb1f6 tempest-GroupsV320Test-2006236285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:07:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-312d2329-7058-42f1-bef9-633eeb6cb1f6 tempest-GroupsV320Test-2006236285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:07:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-312d2329-7058-42f1-bef9-633eeb6cb1f6 tempest-GroupsV320Test-2006236285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:08 devstack sudo[93193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:07:08 devstack sudo[93193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:08 devstack sudo[93193]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-312d2329-7058-42f1-bef9-633eeb6cb1f6 tempest-GroupsV320Test-2006236285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.407s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:08 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-312d2329-7058-42f1-bef9-633eeb6cb1f6 tempest-GroupsV320Test-2006236285 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:07:08 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-312d2329-7058-42f1-bef9-633eeb6cb1f6 tempest-GroupsV320Test-2006236285 None] Delete group completed successfully. Sep 06 08:07:18 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:UPDATE=61,cinder:SELECT=73,cinder:INSERT=19,cinder:DELETE=1 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:07:18 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=68,cinder:INSERT=19,cinder:UPDATE=54,cinder:DELETE=1 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:07:23 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-73b95acc-0b52-4c4f-9bfa-864b16a82374 req-75cf38c4-9910-44c4-a9da-60c2094079e1 tempest-ServerActionsTestOtherA-1802890097 None] Terminate volume connection completed successfully. Sep 06 08:07:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-73b95acc-0b52-4c4f-9bfa-864b16a82374 req-75cf38c4-9910-44c4-a9da-60c2094079e1 tempest-ServerActionsTestOtherA-1802890097 None] Deleting attachment 8c7373ac-bb2e-4dbd-96f7-9c7afbf08f97. {{(pid=87307) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 08:07:24 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:07:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Flow 'volume_create_manager' (70920b5b-7f14-48f8-b5af-bd0d4736099e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:07:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec5b67b0-0f71-4591-b52d-a624a4eae974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec5b67b0-0f71-4591-b52d-a624a4eae974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1950299576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c6d989-cf41-4ec6-9669-51f468dcefda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17371ae0fe04952a852c254eb739ba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:07:24Z,use_quota=True,user_id='62c56120da8f46d5adc97bb96f9c92f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14438699-c85c-4cba-a3e2-94f2e29ec27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14438699-c85c-4cba-a3e2-94f2e29ec27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de56f844-bb2d-416b-9fa9-c4036d6b5a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de56f844-bb2d-416b-9fa9-c4036d6b5a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6c6d989-cf41-4ec6-9669-51f468dcefda', 'volume_name': 'volume-f6c6d989-cf41-4ec6-9669-51f468dcefda', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895ae502-a05c-4151-b5fb-f18b2d7b2167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895ae502-a05c-4151-b5fb-f18b2d7b2167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4269752a-ab5d-426d-891b-e188627297c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:24 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Volume f6c6d989-cf41-4ec6-9669-51f468dcefda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6c6d989-cf41-4ec6-9669-51f468dcefda', 'volume_size': 1} Sep 06 08:07:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:07:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:07:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1950299576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c6d989-cf41-4ec6-9669-51f468dcefda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17371ae0fe04952a852c254eb739ba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:07:24Z,use_quota=True,user_id='62c56120da8f46d5adc97bb96f9c92f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:07:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Creating volume f6c6d989-cf41-4ec6-9669-51f468dcefda {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:07:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:07:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:07:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:07:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:07:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:07:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:07:24 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:07:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:24 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda 1073741824 Sep 06 08:07:24 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:25 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda 1073741824" returned: 0 in 0.905s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:25 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda Sep 06 08:07:25 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:26 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda" returned: 0 in 0.380s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:26 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:07:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:07:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4269752a-ab5d-426d-891b-e188627297c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6c6d989-cf41-4ec6-9669-51f468dcefda', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199c0bdd-9d24-48c0-bfd5-53d4ad48c264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:26 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Volume volume-f6c6d989-cf41-4ec6-9669-51f468dcefda (f6c6d989-cf41-4ec6-9669-51f468dcefda): created successfully Sep 06 08:07:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199c0bdd-9d24-48c0-bfd5-53d4ad48c264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Flow 'volume_create_manager' (70920b5b-7f14-48f8-b5af-bd0d4736099e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:07:26 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-53d92d2d-5aaf-4543-8b5c-2c69eed21a46 tempest-SnapshotsActionsTest-1660447855 None] Created volume successfully. Sep 06 08:07:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-73b95acc-0b52-4c4f-9bfa-864b16a82374 req-ea3751fa-0729-44ae-b769-08598963351b tempest-ServerActionsTestOtherA-1802890097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:07:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-73b95acc-0b52-4c4f-9bfa-864b16a82374 req-ea3751fa-0729-44ae-b769-08598963351b tempest-ServerActionsTestOtherA-1802890097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:07:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-73b95acc-0b52-4c4f-9bfa-864b16a82374 req-ea3751fa-0729-44ae-b769-08598963351b tempest-ServerActionsTestOtherA-1802890097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:07:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-73b95acc-0b52-4c4f-9bfa-864b16a82374 req-ea3751fa-0729-44ae-b769-08598963351b tempest-ServerActionsTestOtherA-1802890097 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0', 'name': 'volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f33b2a0-123d-4803-a3c3-1f6dcbf6249c', 'enforce_multipath': True} {{(pid=87307) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 08:07:26 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-73b95acc-0b52-4c4f-9bfa-864b16a82374 req-ea3751fa-0729-44ae-b769-08598963351b tempest-ServerActionsTestOtherA-1802890097 None] attachment_update completed successfully. Sep 06 08:07:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-629da3f7-23bc-45f8-9da9-2c8220584b9c tempest-SnapshotsActionsTest-1660447855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:07:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-629da3f7-23bc-45f8-9da9-2c8220584b9c tempest-SnapshotsActionsTest-1660447855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:07:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-629da3f7-23bc-45f8-9da9-2c8220584b9c tempest-SnapshotsActionsTest-1660447855 None] Creating offline snapshot 2f49ab6f-c5ca-452a-9c77-2e15f1aa906d of volume f6c6d989-cf41-4ec6-9669-51f468dcefda {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:07:27 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8b6a0b-97cd-4de0-b3ab-78b5ea63f45c]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:07:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-629da3f7-23bc-45f8-9da9-2c8220584b9c tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:27 devstack sudo[93447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda Sep 06 08:07:27 devstack sudo[93447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:28 devstack sudo[93447]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-629da3f7-23bc-45f8-9da9-2c8220584b9c tempest-SnapshotsActionsTest-1660447855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda" returned: 0 in 0.692s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-629da3f7-23bc-45f8-9da9-2c8220584b9c tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:28 devstack sudo[93784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d 1G Sep 06 08:07:28 devstack sudo[93784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:28 devstack sudo[93784]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-629da3f7-23bc-45f8-9da9-2c8220584b9c tempest-SnapshotsActionsTest-1660447855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d 1G" returned: 0 in 0.815s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-629da3f7-23bc-45f8-9da9-2c8220584b9c tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c6d989-cf41-4ec6-9669-51f468dcefda -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:28 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c6d989-cf41-4ec6-9669-51f468dcefda -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d Sep 06 08:07:28 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:29 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-629da3f7-23bc-45f8-9da9-2c8220584b9c tempest-SnapshotsActionsTest-1660447855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c6d989-cf41-4ec6-9669-51f468dcefda -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d" returned: 0 in 0.367s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:29 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-629da3f7-23bc-45f8-9da9-2c8220584b9c tempest-SnapshotsActionsTest-1660447855 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d is being set with open permissions: ugo+rw Sep 06 08:07:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-629da3f7-23bc-45f8-9da9-2c8220584b9c tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:29 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d Sep 06 08:07:29 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:29 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-629da3f7-23bc-45f8-9da9-2c8220584b9c tempest-SnapshotsActionsTest-1660447855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d" returned: 0 in 0.518s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-629da3f7-23bc-45f8-9da9-2c8220584b9c tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:29 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.info Sep 06 08:07:29 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:30 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-629da3f7-23bc-45f8-9da9-2c8220584b9c tempest-SnapshotsActionsTest-1660447855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.info" returned: 0 in 0.745s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:30 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-629da3f7-23bc-45f8-9da9-2c8220584b9c tempest-SnapshotsActionsTest-1660447855 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.info is being set with open permissions: ugo+rw Sep 06 08:07:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-629da3f7-23bc-45f8-9da9-2c8220584b9c tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:30 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.info Sep 06 08:07:30 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:30 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-629da3f7-23bc-45f8-9da9-2c8220584b9c tempest-SnapshotsActionsTest-1660447855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.info" returned: 0 in 0.363s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-629da3f7-23bc-45f8-9da9-2c8220584b9c tempest-SnapshotsActionsTest-1660447855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.767s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:07:31 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-629da3f7-23bc-45f8-9da9-2c8220584b9c tempest-SnapshotsActionsTest-1660447855 None] Create snapshot completed successfully Sep 06 08:07:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-261c79b7-1b31-40da-8cc2-d3f1c404a61a tempest-SnapshotsActionsTest-1660447855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:07:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-261c79b7-1b31-40da-8cc2-d3f1c404a61a tempest-SnapshotsActionsTest-1660447855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:07:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-261c79b7-1b31-40da-8cc2-d3f1c404a61a tempest-SnapshotsActionsTest-1660447855 None] Creating offline snapshot 1c0549cb-cfde-47d2-925f-7ec628b1bb29 of volume f6c6d989-cf41-4ec6-9669-51f468dcefda {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:07:33 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bad3e8-aafe-4255-9410-7a07f0dfb0bf]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:07:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-261c79b7-1b31-40da-8cc2-d3f1c404a61a tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:33 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d Sep 06 08:07:33 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:33 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-261c79b7-1b31-40da-8cc2-d3f1c404a61a tempest-SnapshotsActionsTest-1660447855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d" returned: 0 in 0.610s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-261c79b7-1b31-40da-8cc2-d3f1c404a61a tempest-SnapshotsActionsTest-1660447855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c6d989-cf41-4ec6-9669-51f468dcefda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:07:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-261c79b7-1b31-40da-8cc2-d3f1c404a61a tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.1c0549cb-cfde-47d2-925f-7ec628b1bb29 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:33 devstack sudo[93822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.1c0549cb-cfde-47d2-925f-7ec628b1bb29 1G Sep 06 08:07:33 devstack sudo[93822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:34 devstack sudo[93822]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-261c79b7-1b31-40da-8cc2-d3f1c404a61a tempest-SnapshotsActionsTest-1660447855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.1c0549cb-cfde-47d2-925f-7ec628b1bb29 1G" returned: 0 in 0.870s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-261c79b7-1b31-40da-8cc2-d3f1c404a61a tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.1c0549cb-cfde-47d2-925f-7ec628b1bb29 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:34 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.1c0549cb-cfde-47d2-925f-7ec628b1bb29 Sep 06 08:07:34 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:35 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-261c79b7-1b31-40da-8cc2-d3f1c404a61a tempest-SnapshotsActionsTest-1660447855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.1c0549cb-cfde-47d2-925f-7ec628b1bb29" returned: 0 in 0.488s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:35 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-261c79b7-1b31-40da-8cc2-d3f1c404a61a tempest-SnapshotsActionsTest-1660447855 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.1c0549cb-cfde-47d2-925f-7ec628b1bb29 is being set with open permissions: ugo+rw Sep 06 08:07:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-261c79b7-1b31-40da-8cc2-d3f1c404a61a tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.1c0549cb-cfde-47d2-925f-7ec628b1bb29 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:35 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.1c0549cb-cfde-47d2-925f-7ec628b1bb29 Sep 06 08:07:35 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:35 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-261c79b7-1b31-40da-8cc2-d3f1c404a61a tempest-SnapshotsActionsTest-1660447855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.1c0549cb-cfde-47d2-925f-7ec628b1bb29" returned: 0 in 0.497s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-261c79b7-1b31-40da-8cc2-d3f1c404a61a tempest-SnapshotsActionsTest-1660447855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.672s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:07:35 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-261c79b7-1b31-40da-8cc2-d3f1c404a61a tempest-SnapshotsActionsTest-1660447855 None] Create snapshot completed successfully Sep 06 08:07:36 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-49475db5-a654-4b47-95e7-11063c34610d tempest-SnapshotsActionsTest-1388110016 None] Acquiring lock "cinder-1c0549cb-cfde-47d2-925f-7ec628b1bb29-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:07:36 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-49475db5-a654-4b47-95e7-11063c34610d tempest-SnapshotsActionsTest-1388110016 None] Lock "cinder-1c0549cb-cfde-47d2-925f-7ec628b1bb29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:07:36 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-49475db5-a654-4b47-95e7-11063c34610d tempest-SnapshotsActionsTest-1388110016 None] Acquiring lock "cinder-quobyte-f6c6d989-cf41-4ec6-9669-51f468dcefda" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:07:36 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-49475db5-a654-4b47-95e7-11063c34610d tempest-SnapshotsActionsTest-1388110016 None] Lock "cinder-quobyte-f6c6d989-cf41-4ec6-9669-51f468dcefda" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:07:36 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-49475db5-a654-4b47-95e7-11063c34610d tempest-SnapshotsActionsTest-1388110016 None] Acquiring lock "cinder-quobyte-1c0549cb-cfde-47d2-925f-7ec628b1bb29" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:07:36 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-49475db5-a654-4b47-95e7-11063c34610d tempest-SnapshotsActionsTest-1388110016 None] Lock "cinder-quobyte-1c0549cb-cfde-47d2-925f-7ec628b1bb29" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:07:36 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-49475db5-a654-4b47-95e7-11063c34610d tempest-SnapshotsActionsTest-1388110016 None] Deleting offline snapshot 1c0549cb-cfde-47d2-925f-7ec628b1bb29 of volume f6c6d989-cf41-4ec6-9669-51f468dcefda {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:07:36 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-49475db5-a654-4b47-95e7-11063c34610d tempest-SnapshotsActionsTest-1388110016 None] snapshot_file for this snap is: volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.1c0549cb-cfde-47d2-925f-7ec628b1bb29 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:07:36 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96e878a-39f3-4eec-863f-39d38e7bbc1e]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:07:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-49475db5-a654-4b47-95e7-11063c34610d tempest-SnapshotsActionsTest-1388110016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.1c0549cb-cfde-47d2-925f-7ec628b1bb29 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:36 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.1c0549cb-cfde-47d2-925f-7ec628b1bb29 Sep 06 08:07:36 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:36 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-49475db5-a654-4b47-95e7-11063c34610d tempest-SnapshotsActionsTest-1388110016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.1c0549cb-cfde-47d2-925f-7ec628b1bb29" returned: 0 in 0.417s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:36 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-49475db5-a654-4b47-95e7-11063c34610d tempest-SnapshotsActionsTest-1388110016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c6d989-cf41-4ec6-9669-51f468dcefda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:07:36 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f11e8c-6659-4d73-b8ed-d1dcd266d4fd]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:07:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-49475db5-a654-4b47-95e7-11063c34610d tempest-SnapshotsActionsTest-1388110016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:36 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d Sep 06 08:07:36 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:37 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-49475db5-a654-4b47-95e7-11063c34610d tempest-SnapshotsActionsTest-1388110016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d" returned: 0 in 0.414s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-49475db5-a654-4b47-95e7-11063c34610d tempest-SnapshotsActionsTest-1388110016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c6d989-cf41-4ec6-9669-51f468dcefda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-49475db5-a654-4b47-95e7-11063c34610d tempest-SnapshotsActionsTest-1388110016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.1c0549cb-cfde-47d2-925f-7ec628b1bb29 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:37 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.1c0549cb-cfde-47d2-925f-7ec628b1bb29 Sep 06 08:07:37 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:37 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-49475db5-a654-4b47-95e7-11063c34610d tempest-SnapshotsActionsTest-1388110016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.1c0549cb-cfde-47d2-925f-7ec628b1bb29" returned: 0 in 0.450s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-49475db5-a654-4b47-95e7-11063c34610d tempest-SnapshotsActionsTest-1388110016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.1c0549cb-cfde-47d2-925f-7ec628b1bb29 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:37 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.1c0549cb-cfde-47d2-925f-7ec628b1bb29 Sep 06 08:07:37 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Flow 'volume_create_manager' (a2941c56-6ef0-4ea4-a881-d05928c424b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1249d1e8-3539-4f21-a51b-a2857f74c1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1249d1e8-3539-4f21-a51b-a2857f74c1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2107146402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882fae97-e721-49f6-8139-ec7d3c9cb45a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='407f91e19d464651a2802fe5090483f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:07:38Z,use_quota=True,user_id='7caa8cbd64ff4f0ebebc20ee70861174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1037827-8cd3-4680-9429-3726d26596df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1037827-8cd3-4680-9429-3726d26596df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a4542b-41cf-406e-b782-47fbfd5a8790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a4542b-41cf-406e-b782-47fbfd5a8790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '882fae97-e721-49f6-8139-ec7d3c9cb45a', 'volume_name': 'volume-882fae97-e721-49f6-8139-ec7d3c9cb45a', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f010ad3-bd8f-4417-8f22-4ae6534231b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f010ad3-bd8f-4417-8f22-4ae6534231b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bde3594-c5bb-43c9-a17f-a7e2636aa225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:37 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Volume 882fae97-e721-49f6-8139-ec7d3c9cb45a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-882fae97-e721-49f6-8139-ec7d3c9cb45a', 'volume_size': 1} Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2107146402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882fae97-e721-49f6-8139-ec7d3c9cb45a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='407f91e19d464651a2802fe5090483f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:07:38Z,use_quota=True,user_id='7caa8cbd64ff4f0ebebc20ee70861174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Creating volume 882fae97-e721-49f6-8139-ec7d3c9cb45a {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:07:37 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-882fae97-e721-49f6-8139-ec7d3c9cb45a 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:37 devstack sudo[93891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-882fae97-e721-49f6-8139-ec7d3c9cb45a 1073741824 Sep 06 08:07:37 devstack sudo[93891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:37 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-49475db5-a654-4b47-95e7-11063c34610d tempest-SnapshotsActionsTest-1388110016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.1c0549cb-cfde-47d2-925f-7ec628b1bb29" returned: 0 in 0.276s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-49475db5-a654-4b47-95e7-11063c34610d tempest-SnapshotsActionsTest-1388110016 None] Lock "cinder-quobyte-1c0549cb-cfde-47d2-925f-7ec628b1bb29" released by "_delete_snapshot" :: held 1.681s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:07:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-49475db5-a654-4b47-95e7-11063c34610d tempest-SnapshotsActionsTest-1388110016 None] Lock "cinder-quobyte-f6c6d989-cf41-4ec6-9669-51f468dcefda" released by "delete_snapshot" :: held 1.705s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:07:38 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-49475db5-a654-4b47-95e7-11063c34610d tempest-SnapshotsActionsTest-1388110016 None] Created reservations ['a597cc82-91f5-4bcc-a61c-d16de43ec005', 'c5523a9c-9127-4263-8c63-d593a4126ed8', '3762ac2f-db81-4ff5-93ff-0a3eaa58229a', 'a3db5ef4-4e8d-4b57-baad-8f6b6d857b1a'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:07:38 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-49475db5-a654-4b47-95e7-11063c34610d tempest-SnapshotsActionsTest-1388110016 None] Delete snapshot completed successfully. Sep 06 08:07:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-49475db5-a654-4b47-95e7-11063c34610d tempest-SnapshotsActionsTest-1388110016 None] Lock "cinder-1c0549cb-cfde-47d2-925f-7ec628b1bb29-delete_snapshot" released by "delete_snapshot" :: held 1.856s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:07:38 devstack sudo[93891]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-882fae97-e721-49f6-8139-ec7d3c9cb45a 1073741824" returned: 0 in 0.476s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-882fae97-e721-49f6-8139-ec7d3c9cb45a {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:38 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-882fae97-e721-49f6-8139-ec7d3c9cb45a Sep 06 08:07:38 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:38 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-882fae97-e721-49f6-8139-ec7d3c9cb45a" returned: 0 in 0.287s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:38 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:07:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:07:38 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bde3594-c5bb-43c9-a17f-a7e2636aa225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-882fae97-e721-49f6-8139-ec7d3c9cb45a', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:38 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6cb245-e1de-4651-ab9f-d5a9552dad06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:38 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Volume volume-882fae97-e721-49f6-8139-ec7d3c9cb45a (882fae97-e721-49f6-8139-ec7d3c9cb45a): created successfully Sep 06 08:07:38 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6cb245-e1de-4651-ab9f-d5a9552dad06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:38 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Flow 'volume_create_manager' (a2941c56-6ef0-4ea4-a881-d05928c424b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:07:38 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-69178ee1-aca3-41ab-aa1d-b1e813a88c31 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Created volume successfully. Sep 06 08:07:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-4dcd9d69-f264-4f96-a293-d9dd6a4a5ebc tempest-SnapshotsActionsTest-1660447855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:07:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-4dcd9d69-f264-4f96-a293-d9dd6a4a5ebc tempest-SnapshotsActionsTest-1660447855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:07:38 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-4dcd9d69-f264-4f96-a293-d9dd6a4a5ebc tempest-SnapshotsActionsTest-1660447855 None] Creating offline snapshot fccabc8a-691f-4ede-9b7d-2389c8c236c9 of volume f6c6d989-cf41-4ec6-9669-51f468dcefda {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:07:38 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a6965a-7c87-4f7b-9735-f92df7df1c35]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:07:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4dcd9d69-f264-4f96-a293-d9dd6a4a5ebc tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:39 devstack sudo[93901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d Sep 06 08:07:39 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:39 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4dcd9d69-f264-4f96-a293-d9dd6a4a5ebc tempest-SnapshotsActionsTest-1660447855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d" returned: 0 in 0.364s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-4dcd9d69-f264-4f96-a293-d9dd6a4a5ebc tempest-SnapshotsActionsTest-1660447855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c6d989-cf41-4ec6-9669-51f468dcefda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:07:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4dcd9d69-f264-4f96-a293-d9dd6a4a5ebc tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.fccabc8a-691f-4ede-9b7d-2389c8c236c9 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:39 devstack sudo[93906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.fccabc8a-691f-4ede-9b7d-2389c8c236c9 1G Sep 06 08:07:39 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:39 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4dcd9d69-f264-4f96-a293-d9dd6a4a5ebc tempest-SnapshotsActionsTest-1660447855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.fccabc8a-691f-4ede-9b7d-2389c8c236c9 1G" returned: 0 in 0.429s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4dcd9d69-f264-4f96-a293-d9dd6a4a5ebc tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.fccabc8a-691f-4ede-9b7d-2389c8c236c9 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:39 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.fccabc8a-691f-4ede-9b7d-2389c8c236c9 Sep 06 08:07:39 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:40 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3fc4c2e9-28a0-404a-9f72-817f09f4fdb8 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Acquiring lock "cinder-882fae97-e721-49f6-8139-ec7d3c9cb45a-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:07:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4dcd9d69-f264-4f96-a293-d9dd6a4a5ebc tempest-SnapshotsActionsTest-1660447855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.fccabc8a-691f-4ede-9b7d-2389c8c236c9" returned: 0 in 0.342s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:40 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-4dcd9d69-f264-4f96-a293-d9dd6a4a5ebc tempest-SnapshotsActionsTest-1660447855 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.fccabc8a-691f-4ede-9b7d-2389c8c236c9 is being set with open permissions: ugo+rw Sep 06 08:07:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4dcd9d69-f264-4f96-a293-d9dd6a4a5ebc tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.fccabc8a-691f-4ede-9b7d-2389c8c236c9 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3fc4c2e9-28a0-404a-9f72-817f09f4fdb8 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Lock "cinder-882fae97-e721-49f6-8139-ec7d3c9cb45a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:07:40 devstack sudo[93951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.fccabc8a-691f-4ede-9b7d-2389c8c236c9 Sep 06 08:07:40 devstack sudo[93951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3fc4c2e9-28a0-404a-9f72-817f09f4fdb8 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Acquiring lock "cinder-quobyte-882fae97-e721-49f6-8139-ec7d3c9cb45a" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:07:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3fc4c2e9-28a0-404a-9f72-817f09f4fdb8 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Lock "cinder-quobyte-882fae97-e721-49f6-8139-ec7d3c9cb45a" acquired by "delete_volume" :: waited 0.028s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:07:40 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb575b08-1817-4428-996a-48a9f1cad993]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:07:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3fc4c2e9-28a0-404a-9f72-817f09f4fdb8 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-882fae97-e721-49f6-8139-ec7d3c9cb45a {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:40 devstack sudo[93953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-882fae97-e721-49f6-8139-ec7d3c9cb45a Sep 06 08:07:40 devstack sudo[93953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:40 devstack sudo[93951]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4dcd9d69-f264-4f96-a293-d9dd6a4a5ebc tempest-SnapshotsActionsTest-1660447855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.fccabc8a-691f-4ede-9b7d-2389c8c236c9" returned: 0 in 0.335s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-4dcd9d69-f264-4f96-a293-d9dd6a4a5ebc tempest-SnapshotsActionsTest-1660447855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.569s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:07:40 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-4dcd9d69-f264-4f96-a293-d9dd6a4a5ebc tempest-SnapshotsActionsTest-1660447855 None] Create snapshot completed successfully Sep 06 08:07:40 devstack sudo[93953]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3fc4c2e9-28a0-404a-9f72-817f09f4fdb8 tempest-VolumeQuotasAdminTestJSON-2035371772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-882fae97-e721-49f6-8139-ec7d3c9cb45a" returned: 0 in 0.428s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3fc4c2e9-28a0-404a-9f72-817f09f4fdb8 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-882fae97-e721-49f6-8139-ec7d3c9cb45a {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:40 devstack sudo[93961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-882fae97-e721-49f6-8139-ec7d3c9cb45a Sep 06 08:07:40 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:40 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3fc4c2e9-28a0-404a-9f72-817f09f4fdb8 tempest-VolumeQuotasAdminTestJSON-2035371772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-882fae97-e721-49f6-8139-ec7d3c9cb45a" returned: 0 in 0.270s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3fc4c2e9-28a0-404a-9f72-817f09f4fdb8 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Lock "cinder-quobyte-882fae97-e721-49f6-8139-ec7d3c9cb45a" released by "delete_volume" :: held 0.766s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-3fc4c2e9-28a0-404a-9f72-817f09f4fdb8 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Created reservations ['6906013c-f77f-453d-83f3-8dd2500837cd', '37ab3a03-7302-4f8f-b573-9a9cb1236259', '6f6fd756-4a1c-4402-8adc-8ddde93b0b9e', '24d56a3b-19d6-43f3-9a66-e069d7404f6f'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3fc4c2e9-28a0-404a-9f72-817f09f4fdb8 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3fc4c2e9-28a0-404a-9f72-817f09f4fdb8 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3fc4c2e9-28a0-404a-9f72-817f09f4fdb8 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3fc4c2e9-28a0-404a-9f72-817f09f4fdb8 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3fc4c2e9-28a0-404a-9f72-817f09f4fdb8 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3fc4c2e9-28a0-404a-9f72-817f09f4fdb8 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e625f32e-9983-46a3-9675-bd7daa26bc81 tempest-SnapshotsActionsTest-1388110016 None] Acquiring lock "cinder-fccabc8a-691f-4ede-9b7d-2389c8c236c9-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e625f32e-9983-46a3-9675-bd7daa26bc81 tempest-SnapshotsActionsTest-1388110016 None] Lock "cinder-fccabc8a-691f-4ede-9b7d-2389c8c236c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e625f32e-9983-46a3-9675-bd7daa26bc81 tempest-SnapshotsActionsTest-1388110016 None] Acquiring lock "cinder-quobyte-f6c6d989-cf41-4ec6-9669-51f468dcefda" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:07:41 devstack sudo[93964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:07:41 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e625f32e-9983-46a3-9675-bd7daa26bc81 tempest-SnapshotsActionsTest-1388110016 None] Lock "cinder-quobyte-f6c6d989-cf41-4ec6-9669-51f468dcefda" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e625f32e-9983-46a3-9675-bd7daa26bc81 tempest-SnapshotsActionsTest-1388110016 None] Acquiring lock "cinder-quobyte-fccabc8a-691f-4ede-9b7d-2389c8c236c9" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e625f32e-9983-46a3-9675-bd7daa26bc81 tempest-SnapshotsActionsTest-1388110016 None] Lock "cinder-quobyte-fccabc8a-691f-4ede-9b7d-2389c8c236c9" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-e625f32e-9983-46a3-9675-bd7daa26bc81 tempest-SnapshotsActionsTest-1388110016 None] Deleting offline snapshot fccabc8a-691f-4ede-9b7d-2389c8c236c9 of volume f6c6d989-cf41-4ec6-9669-51f468dcefda {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-e625f32e-9983-46a3-9675-bd7daa26bc81 tempest-SnapshotsActionsTest-1388110016 None] snapshot_file for this snap is: volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.fccabc8a-691f-4ede-9b7d-2389c8c236c9 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ddcedd-15f7-4096-ae33-0240493fa7f9]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e625f32e-9983-46a3-9675-bd7daa26bc81 tempest-SnapshotsActionsTest-1388110016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.fccabc8a-691f-4ede-9b7d-2389c8c236c9 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:41 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.fccabc8a-691f-4ede-9b7d-2389c8c236c9 Sep 06 08:07:41 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:41 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3fc4c2e9-28a0-404a-9f72-817f09f4fdb8 tempest-VolumeQuotasAdminTestJSON-2035371772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.377s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-3fc4c2e9-28a0-404a-9f72-817f09f4fdb8 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:07:41 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-3fc4c2e9-28a0-404a-9f72-817f09f4fdb8 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Deleted volume successfully. Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3fc4c2e9-28a0-404a-9f72-817f09f4fdb8 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Lock "cinder-882fae97-e721-49f6-8139-ec7d3c9cb45a-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:07:41 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e625f32e-9983-46a3-9675-bd7daa26bc81 tempest-SnapshotsActionsTest-1388110016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.fccabc8a-691f-4ede-9b7d-2389c8c236c9" returned: 0 in 0.472s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-e625f32e-9983-46a3-9675-bd7daa26bc81 tempest-SnapshotsActionsTest-1388110016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c6d989-cf41-4ec6-9669-51f468dcefda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fa2f99-aa48-4390-8590-7581ad132c45]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e625f32e-9983-46a3-9675-bd7daa26bc81 tempest-SnapshotsActionsTest-1388110016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:07:41 devstack sudo[93973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d Sep 06 08:07:41 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Flow 'volume_create_manager' (7a7e3aec-e973-4313-a431-7293ae081524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9df89566-e4ec-4c67-8e07-823ed31ad73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9df89566-e4ec-4c67-8e07-823ed31ad73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1567334140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=007f8de0-6cd0-4e72-9237-1a3a578aa73f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='407f91e19d464651a2802fe5090483f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:07:42Z,use_quota=True,user_id='7caa8cbd64ff4f0ebebc20ee70861174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f9519d6-b30a-47aa-9ee5-82b040ba14ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f9519d6-b30a-47aa-9ee5-82b040ba14ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca7c6b5-8bc4-4bad-aba5-23a8239ed3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca7c6b5-8bc4-4bad-aba5-23a8239ed3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '007f8de0-6cd0-4e72-9237-1a3a578aa73f', 'volume_name': 'volume-007f8de0-6cd0-4e72-9237-1a3a578aa73f', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (303f0319-fad1-4c0a-80fc-ddfc8f78dd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (303f0319-fad1-4c0a-80fc-ddfc8f78dd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15685de4-f2a4-477f-9aa1-a8bd0764cc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:42 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Volume 007f8de0-6cd0-4e72-9237-1a3a578aa73f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-007f8de0-6cd0-4e72-9237-1a3a578aa73f', 'volume_size': 1} Sep 06 08:07:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:07:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:07:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1567334140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=007f8de0-6cd0-4e72-9237-1a3a578aa73f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='407f91e19d464651a2802fe5090483f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:07:42Z,use_quota=True,user_id='7caa8cbd64ff4f0ebebc20ee70861174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:07:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Creating volume 007f8de0-6cd0-4e72-9237-1a3a578aa73f {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:07:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:07:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:07:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:07:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:07:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:07:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:07:42 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:07:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-007f8de0-6cd0-4e72-9237-1a3a578aa73f 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:42 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-007f8de0-6cd0-4e72-9237-1a3a578aa73f 1073741824 Sep 06 08:07:42 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:42 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e625f32e-9983-46a3-9675-bd7daa26bc81 tempest-SnapshotsActionsTest-1388110016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d" returned: 0 in 0.471s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-e625f32e-9983-46a3-9675-bd7daa26bc81 tempest-SnapshotsActionsTest-1388110016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c6d989-cf41-4ec6-9669-51f468dcefda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:07:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e625f32e-9983-46a3-9675-bd7daa26bc81 tempest-SnapshotsActionsTest-1388110016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.fccabc8a-691f-4ede-9b7d-2389c8c236c9 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:42 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.fccabc8a-691f-4ede-9b7d-2389c8c236c9 Sep 06 08:07:42 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:42 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-007f8de0-6cd0-4e72-9237-1a3a578aa73f 1073741824" returned: 0 in 0.603s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-007f8de0-6cd0-4e72-9237-1a3a578aa73f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:42 devstack sudo[93989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-007f8de0-6cd0-4e72-9237-1a3a578aa73f Sep 06 08:07:42 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:42 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e625f32e-9983-46a3-9675-bd7daa26bc81 tempest-SnapshotsActionsTest-1388110016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.fccabc8a-691f-4ede-9b7d-2389c8c236c9" returned: 0 in 0.511s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e625f32e-9983-46a3-9675-bd7daa26bc81 tempest-SnapshotsActionsTest-1388110016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.fccabc8a-691f-4ede-9b7d-2389c8c236c9 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:42 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.fccabc8a-691f-4ede-9b7d-2389c8c236c9 Sep 06 08:07:42 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:42 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-007f8de0-6cd0-4e72-9237-1a3a578aa73f" returned: 0 in 0.319s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:43 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:07:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:07:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15685de4-f2a4-477f-9aa1-a8bd0764cc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-007f8de0-6cd0-4e72-9237-1a3a578aa73f', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (470de5ad-59c4-4512-81dc-45fc35fbdf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:43 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Volume volume-007f8de0-6cd0-4e72-9237-1a3a578aa73f (007f8de0-6cd0-4e72-9237-1a3a578aa73f): created successfully Sep 06 08:07:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (470de5ad-59c4-4512-81dc-45fc35fbdf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Flow 'volume_create_manager' (7a7e3aec-e973-4313-a431-7293ae081524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:07:43 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-1b49b36c-dc92-4ab3-9996-ba52a16aee73 tempest-VolumeQuotasAdminTestJSON-2035371772 None] Created volume successfully. Sep 06 08:07:43 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e625f32e-9983-46a3-9675-bd7daa26bc81 tempest-SnapshotsActionsTest-1388110016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.fccabc8a-691f-4ede-9b7d-2389c8c236c9" returned: 0 in 0.336s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e625f32e-9983-46a3-9675-bd7daa26bc81 tempest-SnapshotsActionsTest-1388110016 None] Lock "cinder-quobyte-fccabc8a-691f-4ede-9b7d-2389c8c236c9" released by "_delete_snapshot" :: held 1.925s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:07:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e625f32e-9983-46a3-9675-bd7daa26bc81 tempest-SnapshotsActionsTest-1388110016 None] Lock "cinder-quobyte-f6c6d989-cf41-4ec6-9669-51f468dcefda" released by "delete_snapshot" :: held 1.996s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:07:43 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-e625f32e-9983-46a3-9675-bd7daa26bc81 tempest-SnapshotsActionsTest-1388110016 None] Created reservations ['07c20738-2247-429a-9529-abe4448cb203', '70ab9db7-4904-4bf0-85cb-c0dd155a1c75', '5c810e8e-cf46-42ac-a9b3-09302d7970ca', '76878ed5-0049-4f7e-96ab-527c21b7f83d'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:07:43 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e625f32e-9983-46a3-9675-bd7daa26bc81 tempest-SnapshotsActionsTest-1388110016 None] Delete snapshot completed successfully. Sep 06 08:07:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e625f32e-9983-46a3-9675-bd7daa26bc81 tempest-SnapshotsActionsTest-1388110016 None] Lock "cinder-fccabc8a-691f-4ede-9b7d-2389c8c236c9-delete_snapshot" released by "delete_snapshot" :: held 2.192s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:07:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3220c265-d384-433c-93f0-3cf9c8a95677 tempest-SnapshotsActionsTest-1660447855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:07:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3220c265-d384-433c-93f0-3cf9c8a95677 tempest-SnapshotsActionsTest-1660447855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:07:44 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-3220c265-d384-433c-93f0-3cf9c8a95677 tempest-SnapshotsActionsTest-1660447855 None] Creating offline snapshot 8ee5ad3b-1689-4909-bbd4-d8d96f887705 of volume f6c6d989-cf41-4ec6-9669-51f468dcefda {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:07:44 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5efeda9-3b78-40db-b2c6-80a404a00a0b]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:07:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3220c265-d384-433c-93f0-3cf9c8a95677 tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:44 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-864670a1-9c5a-4acf-a616-b6b44d276d54 tempest-VolumeQuotasAdminTestJSON-441252291 None] Transfer volume completed successfully. Sep 06 08:07:44 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d Sep 06 08:07:44 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:45 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3220c265-d384-433c-93f0-3cf9c8a95677 tempest-SnapshotsActionsTest-1660447855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d" returned: 0 in 0.445s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-3220c265-d384-433c-93f0-3cf9c8a95677 tempest-SnapshotsActionsTest-1660447855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c6d989-cf41-4ec6-9669-51f468dcefda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:07:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3220c265-d384-433c-93f0-3cf9c8a95677 tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.8ee5ad3b-1689-4909-bbd4-d8d96f887705 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:45 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.8ee5ad3b-1689-4909-bbd4-d8d96f887705 1G Sep 06 08:07:45 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-46f7d5d8-26ec-4be4-affe-c5533a300a52 tempest-VolumeQuotasAdminTestJSON-869029180 None] Acquiring lock "cinder-007f8de0-6cd0-4e72-9237-1a3a578aa73f-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:07:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-46f7d5d8-26ec-4be4-affe-c5533a300a52 tempest-VolumeQuotasAdminTestJSON-869029180 None] Lock "cinder-007f8de0-6cd0-4e72-9237-1a3a578aa73f-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:07:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-46f7d5d8-26ec-4be4-affe-c5533a300a52 tempest-VolumeQuotasAdminTestJSON-869029180 None] Acquiring lock "cinder-quobyte-007f8de0-6cd0-4e72-9237-1a3a578aa73f" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:07:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-46f7d5d8-26ec-4be4-affe-c5533a300a52 tempest-VolumeQuotasAdminTestJSON-869029180 None] Lock "cinder-quobyte-007f8de0-6cd0-4e72-9237-1a3a578aa73f" acquired by "delete_volume" :: waited 0.027s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:07:45 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4565690b-c59a-4678-992e-4e8bc371beaa]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:07:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-46f7d5d8-26ec-4be4-affe-c5533a300a52 tempest-VolumeQuotasAdminTestJSON-869029180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-007f8de0-6cd0-4e72-9237-1a3a578aa73f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:45 devstack sudo[94005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-007f8de0-6cd0-4e72-9237-1a3a578aa73f Sep 06 08:07:45 devstack sudo[94005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:45 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3220c265-d384-433c-93f0-3cf9c8a95677 tempest-SnapshotsActionsTest-1660447855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.8ee5ad3b-1689-4909-bbd4-d8d96f887705 1G" returned: 0 in 0.678s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3220c265-d384-433c-93f0-3cf9c8a95677 tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.8ee5ad3b-1689-4909-bbd4-d8d96f887705 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:45 devstack sudo[94012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.8ee5ad3b-1689-4909-bbd4-d8d96f887705 Sep 06 08:07:45 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:45 devstack sudo[94005]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-46f7d5d8-26ec-4be4-affe-c5533a300a52 tempest-VolumeQuotasAdminTestJSON-869029180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-007f8de0-6cd0-4e72-9237-1a3a578aa73f" returned: 0 in 0.526s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-46f7d5d8-26ec-4be4-affe-c5533a300a52 tempest-VolumeQuotasAdminTestJSON-869029180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-007f8de0-6cd0-4e72-9237-1a3a578aa73f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:46 devstack sudo[94018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-007f8de0-6cd0-4e72-9237-1a3a578aa73f Sep 06 08:07:46 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Flow 'volume_create_manager' (9e22e981-ab59-47bc-9c09-0e0f42131400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0636ddb1-bc45-47ac-82af-a6433ba8c2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0636ddb1-bc45-47ac-82af-a6433ba8c2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-434937312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb0125f-4485-4503-8983-3985408e4cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c2ea92397c46ec91eb2dcebf9cd1e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:07:46Z,use_quota=True,user_id='0033a4af28c84efc85a423e04d743086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47406b8-fde7-4f1f-bf98-09d9bba8f594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47406b8-fde7-4f1f-bf98-09d9bba8f594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a46cdea7-f26d-4109-ae5b-14eede2271ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a46cdea7-f26d-4109-ae5b-14eede2271ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eb0125f-4485-4503-8983-3985408e4cef', 'volume_name': 'volume-9eb0125f-4485-4503-8983-3985408e4cef', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05617b4-e63b-478e-8be1-6ba55deab007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05617b4-e63b-478e-8be1-6ba55deab007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ee5516-4035-4748-b737-f5d7172aa414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:46 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Volume 9eb0125f-4485-4503-8983-3985408e4cef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eb0125f-4485-4503-8983-3985408e4cef', 'volume_size': 1} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:07:46 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3220c265-d384-433c-93f0-3cf9c8a95677 tempest-SnapshotsActionsTest-1660447855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.8ee5ad3b-1689-4909-bbd4-d8d96f887705" returned: 0 in 0.441s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:46 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-3220c265-d384-433c-93f0-3cf9c8a95677 tempest-SnapshotsActionsTest-1660447855 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.8ee5ad3b-1689-4909-bbd4-d8d96f887705 is being set with open permissions: ugo+rw Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3220c265-d384-433c-93f0-3cf9c8a95677 tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.8ee5ad3b-1689-4909-bbd4-d8d96f887705 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:46 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.8ee5ad3b-1689-4909-bbd4-d8d96f887705 Sep 06 08:07:46 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:46 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-46f7d5d8-26ec-4be4-affe-c5533a300a52 tempest-VolumeQuotasAdminTestJSON-869029180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-007f8de0-6cd0-4e72-9237-1a3a578aa73f" returned: 0 in 0.358s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-46f7d5d8-26ec-4be4-affe-c5533a300a52 tempest-VolumeQuotasAdminTestJSON-869029180 None] Lock "cinder-quobyte-007f8de0-6cd0-4e72-9237-1a3a578aa73f" released by "delete_volume" :: held 0.949s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-46f7d5d8-26ec-4be4-affe-c5533a300a52 tempest-VolumeQuotasAdminTestJSON-869029180 None] Created reservations ['9ae7d9a3-ce90-427d-9e7a-2fcbea3429b8', '35742f38-8e68-4090-aa62-57b033d4e440', '85926d33-c455-48a6-9936-56ff8c2c6972', 'df5b2547-f8c9-4d2e-bc40-aca12f9dc977'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-46f7d5d8-26ec-4be4-affe-c5533a300a52 tempest-VolumeQuotasAdminTestJSON-869029180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-46f7d5d8-26ec-4be4-affe-c5533a300a52 tempest-VolumeQuotasAdminTestJSON-869029180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-46f7d5d8-26ec-4be4-affe-c5533a300a52 tempest-VolumeQuotasAdminTestJSON-869029180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-46f7d5d8-26ec-4be4-affe-c5533a300a52 tempest-VolumeQuotasAdminTestJSON-869029180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-46f7d5d8-26ec-4be4-affe-c5533a300a52 tempest-VolumeQuotasAdminTestJSON-869029180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-46f7d5d8-26ec-4be4-affe-c5533a300a52 tempest-VolumeQuotasAdminTestJSON-869029180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:46 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3220c265-d384-433c-93f0-3cf9c8a95677 tempest-SnapshotsActionsTest-1660447855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.8ee5ad3b-1689-4909-bbd4-d8d96f887705" returned: 0 in 0.282s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:46 devstack sudo[94029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:07:46 devstack sudo[94029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3220c265-d384-433c-93f0-3cf9c8a95677 tempest-SnapshotsActionsTest-1660447855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.970s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.418s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-434937312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb0125f-4485-4503-8983-3985408e4cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c2ea92397c46ec91eb2dcebf9cd1e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:07:46Z,use_quota=True,user_id='0033a4af28c84efc85a423e04d743086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Creating volume 9eb0125f-4485-4503-8983-3985408e4cef {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:07:46 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9eb0125f-4485-4503-8983-3985408e4cef 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:46 devstack sudo[94032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9eb0125f-4485-4503-8983-3985408e4cef 1073741824 Sep 06 08:07:46 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:46 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-3220c265-d384-433c-93f0-3cf9c8a95677 tempest-SnapshotsActionsTest-1660447855 None] Create snapshot completed successfully Sep 06 08:07:46 devstack sudo[94029]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-46f7d5d8-26ec-4be4-affe-c5533a300a52 tempest-VolumeQuotasAdminTestJSON-869029180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.286s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-46f7d5d8-26ec-4be4-affe-c5533a300a52 tempest-VolumeQuotasAdminTestJSON-869029180 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:07:46 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-46f7d5d8-26ec-4be4-affe-c5533a300a52 tempest-VolumeQuotasAdminTestJSON-869029180 None] Deleted volume successfully. Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-46f7d5d8-26ec-4be4-affe-c5533a300a52 tempest-VolumeQuotasAdminTestJSON-869029180 None] Lock "cinder-007f8de0-6cd0-4e72-9237-1a3a578aa73f-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:07:46 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-025b8058-6e5a-47d5-b893-bf09574ce239 tempest-SnapshotsActionsTest-1388110016 None] Acquiring lock "cinder-8ee5ad3b-1689-4909-bbd4-d8d96f887705-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:07:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-025b8058-6e5a-47d5-b893-bf09574ce239 tempest-SnapshotsActionsTest-1388110016 None] Lock "cinder-8ee5ad3b-1689-4909-bbd4-d8d96f887705-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:07:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-025b8058-6e5a-47d5-b893-bf09574ce239 tempest-SnapshotsActionsTest-1388110016 None] Acquiring lock "cinder-quobyte-f6c6d989-cf41-4ec6-9669-51f468dcefda" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:07:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-025b8058-6e5a-47d5-b893-bf09574ce239 tempest-SnapshotsActionsTest-1388110016 None] Lock "cinder-quobyte-f6c6d989-cf41-4ec6-9669-51f468dcefda" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:07:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-025b8058-6e5a-47d5-b893-bf09574ce239 tempest-SnapshotsActionsTest-1388110016 None] Acquiring lock "cinder-quobyte-8ee5ad3b-1689-4909-bbd4-d8d96f887705" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:07:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-025b8058-6e5a-47d5-b893-bf09574ce239 tempest-SnapshotsActionsTest-1388110016 None] Lock "cinder-quobyte-8ee5ad3b-1689-4909-bbd4-d8d96f887705" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:07:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-025b8058-6e5a-47d5-b893-bf09574ce239 tempest-SnapshotsActionsTest-1388110016 None] Deleting offline snapshot 8ee5ad3b-1689-4909-bbd4-d8d96f887705 of volume f6c6d989-cf41-4ec6-9669-51f468dcefda {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:07:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-025b8058-6e5a-47d5-b893-bf09574ce239 tempest-SnapshotsActionsTest-1388110016 None] snapshot_file for this snap is: volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.8ee5ad3b-1689-4909-bbd4-d8d96f887705 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:07:47 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb68778-2ff5-421b-92fc-ae1590b2302e]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:07:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-025b8058-6e5a-47d5-b893-bf09574ce239 tempest-SnapshotsActionsTest-1388110016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.8ee5ad3b-1689-4909-bbd4-d8d96f887705 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:47 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9eb0125f-4485-4503-8983-3985408e4cef 1073741824" returned: 0 in 0.610s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:47 devstack sudo[94062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.8ee5ad3b-1689-4909-bbd4-d8d96f887705 Sep 06 08:07:47 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9eb0125f-4485-4503-8983-3985408e4cef {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:47 devstack sudo[94064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9eb0125f-4485-4503-8983-3985408e4cef Sep 06 08:07:47 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:47 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-025b8058-6e5a-47d5-b893-bf09574ce239 tempest-SnapshotsActionsTest-1388110016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.8ee5ad3b-1689-4909-bbd4-d8d96f887705" returned: 0 in 0.457s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-025b8058-6e5a-47d5-b893-bf09574ce239 tempest-SnapshotsActionsTest-1388110016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c6d989-cf41-4ec6-9669-51f468dcefda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:07:47 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9eb0125f-4485-4503-8983-3985408e4cef" returned: 0 in 0.331s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:07:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:07:47 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[657e530b-b45d-468b-8eed-2cedf82c9b13]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:07:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-025b8058-6e5a-47d5-b893-bf09574ce239 tempest-SnapshotsActionsTest-1388110016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ee5516-4035-4748-b737-f5d7172aa414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eb0125f-4485-4503-8983-3985408e4cef', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc87e29-388a-4e82-aaa0-0d1f369d0913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:47 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Volume volume-9eb0125f-4485-4503-8983-3985408e4cef (9eb0125f-4485-4503-8983-3985408e4cef): created successfully Sep 06 08:07:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc87e29-388a-4e82-aaa0-0d1f369d0913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Flow 'volume_create_manager' (9e22e981-ab59-47bc-9c09-0e0f42131400) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:07:47 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-917e230f-3229-47e9-a598-5f5fcf0c824d tempest-AttachVolumeNegativeTest-105042574 None] Created volume successfully. Sep 06 08:07:47 devstack sudo[94084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d Sep 06 08:07:47 devstack sudo[94084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:48 devstack sudo[94084]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-025b8058-6e5a-47d5-b893-bf09574ce239 tempest-SnapshotsActionsTest-1388110016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d" returned: 0 in 0.440s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:48 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-025b8058-6e5a-47d5-b893-bf09574ce239 tempest-SnapshotsActionsTest-1388110016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c6d989-cf41-4ec6-9669-51f468dcefda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:07:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-025b8058-6e5a-47d5-b893-bf09574ce239 tempest-SnapshotsActionsTest-1388110016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.8ee5ad3b-1689-4909-bbd4-d8d96f887705 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:48 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.8ee5ad3b-1689-4909-bbd4-d8d96f887705 Sep 06 08:07:48 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:48 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-025b8058-6e5a-47d5-b893-bf09574ce239 tempest-SnapshotsActionsTest-1388110016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.8ee5ad3b-1689-4909-bbd4-d8d96f887705" returned: 0 in 0.494s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-025b8058-6e5a-47d5-b893-bf09574ce239 tempest-SnapshotsActionsTest-1388110016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.8ee5ad3b-1689-4909-bbd4-d8d96f887705 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:48 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.8ee5ad3b-1689-4909-bbd4-d8d96f887705 Sep 06 08:07:48 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:48 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-025b8058-6e5a-47d5-b893-bf09574ce239 tempest-SnapshotsActionsTest-1388110016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.8ee5ad3b-1689-4909-bbd4-d8d96f887705" returned: 0 in 0.318s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:48 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-025b8058-6e5a-47d5-b893-bf09574ce239 tempest-SnapshotsActionsTest-1388110016 None] Lock "cinder-quobyte-8ee5ad3b-1689-4909-bbd4-d8d96f887705" released by "_delete_snapshot" :: held 1.854s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:07:48 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-025b8058-6e5a-47d5-b893-bf09574ce239 tempest-SnapshotsActionsTest-1388110016 None] Lock "cinder-quobyte-f6c6d989-cf41-4ec6-9669-51f468dcefda" released by "delete_snapshot" :: held 1.902s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:07:49 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-025b8058-6e5a-47d5-b893-bf09574ce239 tempest-SnapshotsActionsTest-1388110016 None] Created reservations ['25b1bce1-b375-40ed-bed1-1e703cbbc0db', 'ea0d2301-563e-43f9-9ea7-5aa5fded0d8a', '91bfc07e-50b7-4de6-bd15-a304a985db89', '4841ae4e-23c6-42c6-bad7-2a9bf598c4cc'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:07:49 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-025b8058-6e5a-47d5-b893-bf09574ce239 tempest-SnapshotsActionsTest-1388110016 None] Delete snapshot completed successfully. Sep 06 08:07:49 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-025b8058-6e5a-47d5-b893-bf09574ce239 tempest-SnapshotsActionsTest-1388110016 None] Lock "cinder-8ee5ad3b-1689-4909-bbd4-d8d96f887705-delete_snapshot" released by "delete_snapshot" :: held 2.065s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:07:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-c6d9931e-9e6e-468c-bdde-01e2e56c44f1 req-fe34bc0b-d275-4564-8eb3-b973b6fa3f3b tempest-AttachVolumeNegativeTest-105042574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:07:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-c6d9931e-9e6e-468c-bdde-01e2e56c44f1 req-fe34bc0b-d275-4564-8eb3-b973b6fa3f3b tempest-AttachVolumeNegativeTest-105042574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:07:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-c6d9931e-9e6e-468c-bdde-01e2e56c44f1 req-fe34bc0b-d275-4564-8eb3-b973b6fa3f3b tempest-AttachVolumeNegativeTest-105042574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:07:49 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-c6d9931e-9e6e-468c-bdde-01e2e56c44f1 req-fe34bc0b-d275-4564-8eb3-b973b6fa3f3b tempest-AttachVolumeNegativeTest-105042574 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0', 'name': 'volume-9eb0125f-4485-4503-8983-3985408e4cef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6dcee71e-9328-41f8-b022-c3dbf698ba5a', 'enforce_multipath': True} {{(pid=87307) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 08:07:49 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-c6d9931e-9e6e-468c-bdde-01e2e56c44f1 req-fe34bc0b-d275-4564-8eb3-b973b6fa3f3b tempest-AttachVolumeNegativeTest-105042574 None] attachment_update completed successfully. Sep 06 08:07:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-522e8946-4434-42c8-85b4-b6545dee6e1d tempest-SnapshotsActionsTest-1660447855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:07:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-522e8946-4434-42c8-85b4-b6545dee6e1d tempest-SnapshotsActionsTest-1660447855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:07:49 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-522e8946-4434-42c8-85b4-b6545dee6e1d tempest-SnapshotsActionsTest-1660447855 None] Creating offline snapshot d9f4a234-efdd-4011-9575-d281a2a118cc of volume f6c6d989-cf41-4ec6-9669-51f468dcefda {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:07:49 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1845227-4be9-4a96-baa5-2c3a76613a17]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:07:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-522e8946-4434-42c8-85b4-b6545dee6e1d tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:49 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d Sep 06 08:07:49 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:50 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-522e8946-4434-42c8-85b4-b6545dee6e1d tempest-SnapshotsActionsTest-1660447855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d" returned: 0 in 0.456s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:50 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-522e8946-4434-42c8-85b4-b6545dee6e1d tempest-SnapshotsActionsTest-1660447855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c6d989-cf41-4ec6-9669-51f468dcefda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:07:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-522e8946-4434-42c8-85b4-b6545dee6e1d tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.d9f4a234-efdd-4011-9575-d281a2a118cc 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:50 devstack sudo[94120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.d9f4a234-efdd-4011-9575-d281a2a118cc 1G Sep 06 08:07:50 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:50 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-522e8946-4434-42c8-85b4-b6545dee6e1d tempest-SnapshotsActionsTest-1660447855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.d9f4a234-efdd-4011-9575-d281a2a118cc 1G" returned: 0 in 0.532s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-522e8946-4434-42c8-85b4-b6545dee6e1d tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.d9f4a234-efdd-4011-9575-d281a2a118cc {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:50 devstack sudo[94126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.d9f4a234-efdd-4011-9575-d281a2a118cc Sep 06 08:07:50 devstack sudo[94126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:50 devstack sudo[94126]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-522e8946-4434-42c8-85b4-b6545dee6e1d tempest-SnapshotsActionsTest-1660447855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.d9f4a234-efdd-4011-9575-d281a2a118cc" returned: 0 in 0.308s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:50 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-522e8946-4434-42c8-85b4-b6545dee6e1d tempest-SnapshotsActionsTest-1660447855 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.d9f4a234-efdd-4011-9575-d281a2a118cc is being set with open permissions: ugo+rw Sep 06 08:07:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-522e8946-4434-42c8-85b4-b6545dee6e1d tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.d9f4a234-efdd-4011-9575-d281a2a118cc {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:50 devstack sudo[94132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.d9f4a234-efdd-4011-9575-d281a2a118cc Sep 06 08:07:50 devstack sudo[94132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:51 devstack sudo[94132]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-522e8946-4434-42c8-85b4-b6545dee6e1d tempest-SnapshotsActionsTest-1660447855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.d9f4a234-efdd-4011-9575-d281a2a118cc" returned: 0 in 0.266s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-522e8946-4434-42c8-85b4-b6545dee6e1d tempest-SnapshotsActionsTest-1660447855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.713s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:07:51 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-522e8946-4434-42c8-85b4-b6545dee6e1d tempest-SnapshotsActionsTest-1660447855 None] Create snapshot completed successfully Sep 06 08:07:51 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-de18dade-a55d-4ff9-a5dc-fa86338831d2 tempest-SnapshotsActionsTest-1388110016 None] Acquiring lock "cinder-d9f4a234-efdd-4011-9575-d281a2a118cc-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:07:51 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-de18dade-a55d-4ff9-a5dc-fa86338831d2 tempest-SnapshotsActionsTest-1388110016 None] Lock "cinder-d9f4a234-efdd-4011-9575-d281a2a118cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:07:51 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-de18dade-a55d-4ff9-a5dc-fa86338831d2 tempest-SnapshotsActionsTest-1388110016 None] Acquiring lock "cinder-quobyte-f6c6d989-cf41-4ec6-9669-51f468dcefda" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:07:51 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-de18dade-a55d-4ff9-a5dc-fa86338831d2 tempest-SnapshotsActionsTest-1388110016 None] Lock "cinder-quobyte-f6c6d989-cf41-4ec6-9669-51f468dcefda" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:07:51 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-de18dade-a55d-4ff9-a5dc-fa86338831d2 tempest-SnapshotsActionsTest-1388110016 None] Acquiring lock "cinder-quobyte-d9f4a234-efdd-4011-9575-d281a2a118cc" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:07:51 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-de18dade-a55d-4ff9-a5dc-fa86338831d2 tempest-SnapshotsActionsTest-1388110016 None] Lock "cinder-quobyte-d9f4a234-efdd-4011-9575-d281a2a118cc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:07:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-de18dade-a55d-4ff9-a5dc-fa86338831d2 tempest-SnapshotsActionsTest-1388110016 None] Deleting offline snapshot d9f4a234-efdd-4011-9575-d281a2a118cc of volume f6c6d989-cf41-4ec6-9669-51f468dcefda {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:07:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-de18dade-a55d-4ff9-a5dc-fa86338831d2 tempest-SnapshotsActionsTest-1388110016 None] snapshot_file for this snap is: volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.d9f4a234-efdd-4011-9575-d281a2a118cc {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:07:51 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1072fd3-0971-4c62-bcb4-f40a4ee53847]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:07:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-de18dade-a55d-4ff9-a5dc-fa86338831d2 tempest-SnapshotsActionsTest-1388110016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.d9f4a234-efdd-4011-9575-d281a2a118cc {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:51 devstack sudo[94136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.d9f4a234-efdd-4011-9575-d281a2a118cc Sep 06 08:07:51 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:51 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-215068bb-aa59-41ff-aeab-813a1ab56644 req-d0310781-e9e2-4bea-b4b6-206afa28c23d tempest-AttachVolumeNegativeTest-105042574 None] Terminate volume connection completed successfully. Sep 06 08:07:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-215068bb-aa59-41ff-aeab-813a1ab56644 req-d0310781-e9e2-4bea-b4b6-206afa28c23d tempest-AttachVolumeNegativeTest-105042574 None] Deleting attachment 6dcee71e-9328-41f8-b022-c3dbf698ba5a. {{(pid=87307) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 08:07:52 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-de18dade-a55d-4ff9-a5dc-fa86338831d2 tempest-SnapshotsActionsTest-1388110016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.d9f4a234-efdd-4011-9575-d281a2a118cc" returned: 0 in 0.418s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:52 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-de18dade-a55d-4ff9-a5dc-fa86338831d2 tempest-SnapshotsActionsTest-1388110016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c6d989-cf41-4ec6-9669-51f468dcefda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:07:52 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b255906-dc1d-4cb3-b56b-cf67644cd6af]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:07:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-de18dade-a55d-4ff9-a5dc-fa86338831d2 tempest-SnapshotsActionsTest-1388110016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:52 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d Sep 06 08:07:52 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:52 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-de18dade-a55d-4ff9-a5dc-fa86338831d2 tempest-SnapshotsActionsTest-1388110016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d" returned: 0 in 0.402s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:52 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-de18dade-a55d-4ff9-a5dc-fa86338831d2 tempest-SnapshotsActionsTest-1388110016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c6d989-cf41-4ec6-9669-51f468dcefda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:07:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-de18dade-a55d-4ff9-a5dc-fa86338831d2 tempest-SnapshotsActionsTest-1388110016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.d9f4a234-efdd-4011-9575-d281a2a118cc {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:52 devstack sudo[94148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.d9f4a234-efdd-4011-9575-d281a2a118cc Sep 06 08:07:52 devstack sudo[94148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:53 devstack sudo[94148]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-de18dade-a55d-4ff9-a5dc-fa86338831d2 tempest-SnapshotsActionsTest-1388110016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.d9f4a234-efdd-4011-9575-d281a2a118cc" returned: 0 in 0.448s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-de18dade-a55d-4ff9-a5dc-fa86338831d2 tempest-SnapshotsActionsTest-1388110016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.d9f4a234-efdd-4011-9575-d281a2a118cc {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:53 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.d9f4a234-efdd-4011-9575-d281a2a118cc Sep 06 08:07:53 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:53 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-de18dade-a55d-4ff9-a5dc-fa86338831d2 tempest-SnapshotsActionsTest-1388110016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.d9f4a234-efdd-4011-9575-d281a2a118cc" returned: 0 in 0.384s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-de18dade-a55d-4ff9-a5dc-fa86338831d2 tempest-SnapshotsActionsTest-1388110016 None] Lock "cinder-quobyte-d9f4a234-efdd-4011-9575-d281a2a118cc" released by "_delete_snapshot" :: held 1.776s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:07:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-de18dade-a55d-4ff9-a5dc-fa86338831d2 tempest-SnapshotsActionsTest-1388110016 None] Lock "cinder-quobyte-f6c6d989-cf41-4ec6-9669-51f468dcefda" released by "delete_snapshot" :: held 1.803s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:07:53 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-de18dade-a55d-4ff9-a5dc-fa86338831d2 tempest-SnapshotsActionsTest-1388110016 None] Created reservations ['53ca7e25-80a3-4f0e-ba86-52853d008d1c', 'f727603c-57d4-499d-aadb-96b592a70bf8', '6e319ec9-7bc3-4d5f-b783-d8ab87508e44', '20ca707e-a1f4-4a2e-b2eb-e7d9fa571b39'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:07:53 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-de18dade-a55d-4ff9-a5dc-fa86338831d2 tempest-SnapshotsActionsTest-1388110016 None] Delete snapshot completed successfully. Sep 06 08:07:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-de18dade-a55d-4ff9-a5dc-fa86338831d2 tempest-SnapshotsActionsTest-1388110016 None] Lock "cinder-d9f4a234-efdd-4011-9575-d281a2a118cc-delete_snapshot" released by "delete_snapshot" :: held 2.029s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:07:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-edf540d5-2517-4fef-b27c-2dfc6acca64e tempest-SnapshotsActionsTest-1660447855 None] Acquiring lock "cinder-2f49ab6f-c5ca-452a-9c77-2e15f1aa906d-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:07:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-edf540d5-2517-4fef-b27c-2dfc6acca64e tempest-SnapshotsActionsTest-1660447855 None] Lock "cinder-2f49ab6f-c5ca-452a-9c77-2e15f1aa906d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:07:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-edf540d5-2517-4fef-b27c-2dfc6acca64e tempest-SnapshotsActionsTest-1660447855 None] Acquiring lock "cinder-quobyte-f6c6d989-cf41-4ec6-9669-51f468dcefda" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:07:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-edf540d5-2517-4fef-b27c-2dfc6acca64e tempest-SnapshotsActionsTest-1660447855 None] Lock "cinder-quobyte-f6c6d989-cf41-4ec6-9669-51f468dcefda" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:07:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-edf540d5-2517-4fef-b27c-2dfc6acca64e tempest-SnapshotsActionsTest-1660447855 None] Acquiring lock "cinder-quobyte-2f49ab6f-c5ca-452a-9c77-2e15f1aa906d" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:07:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-edf540d5-2517-4fef-b27c-2dfc6acca64e tempest-SnapshotsActionsTest-1660447855 None] Lock "cinder-quobyte-2f49ab6f-c5ca-452a-9c77-2e15f1aa906d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:07:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-edf540d5-2517-4fef-b27c-2dfc6acca64e tempest-SnapshotsActionsTest-1660447855 None] Deleting offline snapshot 2f49ab6f-c5ca-452a-9c77-2e15f1aa906d of volume f6c6d989-cf41-4ec6-9669-51f468dcefda {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:07:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-edf540d5-2517-4fef-b27c-2dfc6acca64e tempest-SnapshotsActionsTest-1660447855 None] snapshot_file for this snap is: volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:07:54 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[46608f91-01e4-4354-8ba8-ed7c91a26a7b]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:07:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-edf540d5-2517-4fef-b27c-2dfc6acca64e tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:54 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d Sep 06 08:07:54 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:55 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-edf540d5-2517-4fef-b27c-2dfc6acca64e tempest-SnapshotsActionsTest-1660447855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d" returned: 0 in 0.578s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-edf540d5-2517-4fef-b27c-2dfc6acca64e tempest-SnapshotsActionsTest-1660447855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c6d989-cf41-4ec6-9669-51f468dcefda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:07:55 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9c70fa-aab6-48c5-8f09-0e9bc7ff017a]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:07:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-edf540d5-2517-4fef-b27c-2dfc6acca64e tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:55 devstack sudo[94192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda Sep 06 08:07:55 devstack sudo[94192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:56 devstack sudo[94192]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-edf540d5-2517-4fef-b27c-2dfc6acca64e tempest-SnapshotsActionsTest-1660447855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda" returned: 0 in 0.655s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-edf540d5-2517-4fef-b27c-2dfc6acca64e tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:56 devstack sudo[94206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d Sep 06 08:07:56 devstack sudo[94206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:56 devstack sudo[94206]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-edf540d5-2517-4fef-b27c-2dfc6acca64e tempest-SnapshotsActionsTest-1660447855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d" returned: 0 in 0.444s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-edf540d5-2517-4fef-b27c-2dfc6acca64e tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:56 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d Sep 06 08:07:56 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:56 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-edf540d5-2517-4fef-b27c-2dfc6acca64e tempest-SnapshotsActionsTest-1660447855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda.2f49ab6f-c5ca-452a-9c77-2e15f1aa906d" returned: 0 in 0.279s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-edf540d5-2517-4fef-b27c-2dfc6acca64e tempest-SnapshotsActionsTest-1660447855 None] Lock "cinder-quobyte-2f49ab6f-c5ca-452a-9c77-2e15f1aa906d" released by "_delete_snapshot" :: held 2.114s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:07:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-edf540d5-2517-4fef-b27c-2dfc6acca64e tempest-SnapshotsActionsTest-1660447855 None] Lock "cinder-quobyte-f6c6d989-cf41-4ec6-9669-51f468dcefda" released by "delete_snapshot" :: held 2.144s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:07:56 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-edf540d5-2517-4fef-b27c-2dfc6acca64e tempest-SnapshotsActionsTest-1660447855 None] Created reservations ['50f03502-1856-48dd-86e6-f96bb792de09', '6a89cc07-0ffe-44ab-8ec3-ae0281bc7bcb', '0b322530-0975-4156-8d1f-e3fc481f4750', '2301a5ae-a15d-4fc6-bf2a-4d14600dbf4a'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:07:56 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-edf540d5-2517-4fef-b27c-2dfc6acca64e tempest-SnapshotsActionsTest-1660447855 None] Delete snapshot completed successfully. Sep 06 08:07:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-edf540d5-2517-4fef-b27c-2dfc6acca64e tempest-SnapshotsActionsTest-1660447855 None] Lock "cinder-2f49ab6f-c5ca-452a-9c77-2e15f1aa906d-delete_snapshot" released by "delete_snapshot" :: held 2.332s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:07:57 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:07:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Flow 'volume_create_manager' (6e2281eb-19f2-4ea6-879c-a4aa7aa6e474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:07:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db86760d-dc33-4400-9faf-cb214f5776e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db86760d-dc33-4400-9faf-cb214f5776e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1753410476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279157e3-8407-4ea8-bb69-2c0de370c25f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e60ead7b06e4d568c1f71a3ef84aeca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:07:57Z,use_quota=True,user_id='3f43a6fe655646d497df90484112fc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bce999a-a83a-4506-8c84-fa6df42d0f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bce999a-a83a-4506-8c84-fa6df42d0f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6add0b3-bb89-4639-bb07-1afb3dd09d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6add0b3-bb89-4639-bb07-1afb3dd09d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '279157e3-8407-4ea8-bb69-2c0de370c25f', 'volume_name': 'volume-279157e3-8407-4ea8-bb69-2c0de370c25f', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905b0a73-ea4e-471e-be17-aa3d23502976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905b0a73-ea4e-471e-be17-aa3d23502976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d0404f-0691-4acc-a8c4-2b0aa758116b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:57 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Volume 279157e3-8407-4ea8-bb69-2c0de370c25f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-279157e3-8407-4ea8-bb69-2c0de370c25f', 'volume_size': 1} Sep 06 08:07:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:07:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:07:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1753410476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279157e3-8407-4ea8-bb69-2c0de370c25f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e60ead7b06e4d568c1f71a3ef84aeca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:07:57Z,use_quota=True,user_id='3f43a6fe655646d497df90484112fc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:07:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Creating volume 279157e3-8407-4ea8-bb69-2c0de370c25f {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:07:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:07:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:07:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:07:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:07:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:07:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:07:57 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:07:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-279157e3-8407-4ea8-bb69-2c0de370c25f 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:57 devstack sudo[94220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-279157e3-8407-4ea8-bb69-2c0de370c25f 1073741824 Sep 06 08:07:57 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2f43a1d9-70cd-423b-8ce8-b971fa0a57ec tempest-SnapshotsActionsTest-1660447855 None] Acquiring lock "cinder-f6c6d989-cf41-4ec6-9669-51f468dcefda-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:07:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2f43a1d9-70cd-423b-8ce8-b971fa0a57ec tempest-SnapshotsActionsTest-1660447855 None] Lock "cinder-f6c6d989-cf41-4ec6-9669-51f468dcefda-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:07:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2f43a1d9-70cd-423b-8ce8-b971fa0a57ec tempest-SnapshotsActionsTest-1660447855 None] Acquiring lock "cinder-quobyte-f6c6d989-cf41-4ec6-9669-51f468dcefda" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:07:58 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-279157e3-8407-4ea8-bb69-2c0de370c25f 1073741824" returned: 0 in 0.530s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2f43a1d9-70cd-423b-8ce8-b971fa0a57ec tempest-SnapshotsActionsTest-1660447855 None] Lock "cinder-quobyte-f6c6d989-cf41-4ec6-9669-51f468dcefda" acquired by "delete_volume" :: waited 0.023s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:07:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-279157e3-8407-4ea8-bb69-2c0de370c25f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:58 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa91467d-ce42-4f30-a6ad-f9483d39cd5a]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:07:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2f43a1d9-70cd-423b-8ce8-b971fa0a57ec tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:58 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-279157e3-8407-4ea8-bb69-2c0de370c25f Sep 06 08:07:58 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:58 devstack sudo[94229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda Sep 06 08:07:58 devstack sudo[94229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:58 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-279157e3-8407-4ea8-bb69-2c0de370c25f" returned: 0 in 0.384s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:58 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:07:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:07:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d0404f-0691-4acc-a8c4-2b0aa758116b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-279157e3-8407-4ea8-bb69-2c0de370c25f', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178d5bf6-67bc-4cc7-bbc4-c616f69448e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:07:58 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Volume volume-279157e3-8407-4ea8-bb69-2c0de370c25f (279157e3-8407-4ea8-bb69-2c0de370c25f): created successfully Sep 06 08:07:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178d5bf6-67bc-4cc7-bbc4-c616f69448e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:07:58 devstack sudo[94229]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Flow 'volume_create_manager' (6e2281eb-19f2-4ea6-879c-a4aa7aa6e474) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:07:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2f43a1d9-70cd-423b-8ce8-b971fa0a57ec tempest-SnapshotsActionsTest-1660447855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda" returned: 0 in 0.461s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2f43a1d9-70cd-423b-8ce8-b971fa0a57ec tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:58 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-cd73d078-63e3-452a-b420-13229f482c83 tempest-VolumesServicesTestJSON-40956285 None] Created volume successfully. Sep 06 08:07:58 devstack sudo[94236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda Sep 06 08:07:58 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:58 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2f43a1d9-70cd-423b-8ce8-b971fa0a57ec tempest-SnapshotsActionsTest-1660447855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6c6d989-cf41-4ec6-9669-51f468dcefda" returned: 0 in 0.311s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2f43a1d9-70cd-423b-8ce8-b971fa0a57ec tempest-SnapshotsActionsTest-1660447855 None] Lock "cinder-quobyte-f6c6d989-cf41-4ec6-9669-51f468dcefda" released by "delete_volume" :: held 0.873s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:07:59 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-2f43a1d9-70cd-423b-8ce8-b971fa0a57ec tempest-SnapshotsActionsTest-1660447855 None] Created reservations ['7ce164b4-3e0b-4268-9d10-7d42f9de5278', '708b259e-73d4-4d19-a656-9cca8d5962b0', 'd763e905-d0fc-49cd-a40a-9e0a7608fe5a', 'be07290a-c7d9-4c13-99d0-f72bf815af10'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:07:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2f43a1d9-70cd-423b-8ce8-b971fa0a57ec tempest-SnapshotsActionsTest-1660447855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:07:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2f43a1d9-70cd-423b-8ce8-b971fa0a57ec tempest-SnapshotsActionsTest-1660447855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:07:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2f43a1d9-70cd-423b-8ce8-b971fa0a57ec tempest-SnapshotsActionsTest-1660447855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:07:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2f43a1d9-70cd-423b-8ce8-b971fa0a57ec tempest-SnapshotsActionsTest-1660447855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:07:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2f43a1d9-70cd-423b-8ce8-b971fa0a57ec tempest-SnapshotsActionsTest-1660447855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:07:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2f43a1d9-70cd-423b-8ce8-b971fa0a57ec tempest-SnapshotsActionsTest-1660447855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:07:59 devstack sudo[94249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:07:59 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:07:59 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root Sep 06 08:07:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2f43a1d9-70cd-423b-8ce8-b971fa0a57ec tempest-SnapshotsActionsTest-1660447855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.444s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:07:59 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-2f43a1d9-70cd-423b-8ce8-b971fa0a57ec tempest-SnapshotsActionsTest-1660447855 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:07:59 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-2f43a1d9-70cd-423b-8ce8-b971fa0a57ec tempest-SnapshotsActionsTest-1660447855 None] Deleted volume successfully. Sep 06 08:07:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager._thread_info {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:07:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread count: 28 {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 08:07:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread info: [<_MainThread(MainThread, started 139985167040640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:07:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2f43a1d9-70cd-423b-8ce8-b971fa0a57ec tempest-SnapshotsActionsTest-1660447855 None] Lock "cinder-f6c6d989-cf41-4ec6-9669-51f468dcefda-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:07:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2242b2b8-367d-45e7-a587-39924007cb59 tempest-VolumesServicesTestJSON-40956285 None] Acquiring lock "cinder-279157e3-8407-4ea8-bb69-2c0de370c25f-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:07:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2242b2b8-367d-45e7-a587-39924007cb59 tempest-VolumesServicesTestJSON-40956285 None] Lock "cinder-279157e3-8407-4ea8-bb69-2c0de370c25f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2242b2b8-367d-45e7-a587-39924007cb59 tempest-VolumesServicesTestJSON-40956285 None] Acquiring lock "cinder-quobyte-279157e3-8407-4ea8-bb69-2c0de370c25f" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2242b2b8-367d-45e7-a587-39924007cb59 tempest-VolumesServicesTestJSON-40956285 None] Lock "cinder-quobyte-279157e3-8407-4ea8-bb69-2c0de370c25f" acquired by "delete_volume" :: waited 0.024s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:00 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[165acae8-49b4-48e9-b2bf-27df393dde9f]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:08:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2242b2b8-367d-45e7-a587-39924007cb59 tempest-VolumesServicesTestJSON-40956285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-279157e3-8407-4ea8-bb69-2c0de370c25f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:00 devstack sudo[94267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-279157e3-8407-4ea8-bb69-2c0de370c25f Sep 06 08:08:00 devstack sudo[94267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:00 devstack sudo[94267]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2242b2b8-367d-45e7-a587-39924007cb59 tempest-VolumesServicesTestJSON-40956285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-279157e3-8407-4ea8-bb69-2c0de370c25f" returned: 0 in 0.503s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2242b2b8-367d-45e7-a587-39924007cb59 tempest-VolumesServicesTestJSON-40956285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-279157e3-8407-4ea8-bb69-2c0de370c25f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:00 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-279157e3-8407-4ea8-bb69-2c0de370c25f Sep 06 08:08:00 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:00 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2242b2b8-367d-45e7-a587-39924007cb59 tempest-VolumesServicesTestJSON-40956285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-279157e3-8407-4ea8-bb69-2c0de370c25f" returned: 0 in 0.270s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2242b2b8-367d-45e7-a587-39924007cb59 tempest-VolumesServicesTestJSON-40956285 None] Lock "cinder-quobyte-279157e3-8407-4ea8-bb69-2c0de370c25f" released by "delete_volume" :: held 0.851s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:08:00 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-2242b2b8-367d-45e7-a587-39924007cb59 tempest-VolumesServicesTestJSON-40956285 None] Created reservations ['09385ed2-2d4a-444f-bff8-da999e23cabe', '36715ae8-4b39-4f68-a09c-735f1013b327', 'f906fd72-c53d-481b-9b1e-26ff82fa2adc', '302b57e8-07ef-4d04-ad92-95bb23b261b4'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:08:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2242b2b8-367d-45e7-a587-39924007cb59 tempest-VolumesServicesTestJSON-40956285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:08:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2242b2b8-367d-45e7-a587-39924007cb59 tempest-VolumesServicesTestJSON-40956285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:08:01 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2242b2b8-367d-45e7-a587-39924007cb59 tempest-VolumesServicesTestJSON-40956285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:08:01 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2242b2b8-367d-45e7-a587-39924007cb59 tempest-VolumesServicesTestJSON-40956285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:08:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2242b2b8-367d-45e7-a587-39924007cb59 tempest-VolumesServicesTestJSON-40956285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:08:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2242b2b8-367d-45e7-a587-39924007cb59 tempest-VolumesServicesTestJSON-40956285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:01 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:08:01 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:01 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2242b2b8-367d-45e7-a587-39924007cb59 tempest-VolumesServicesTestJSON-40956285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.373s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:01 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-2242b2b8-367d-45e7-a587-39924007cb59 tempest-VolumesServicesTestJSON-40956285 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:08:01 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-2242b2b8-367d-45e7-a587-39924007cb59 tempest-VolumesServicesTestJSON-40956285 None] Deleted volume successfully. Sep 06 08:08:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2242b2b8-367d-45e7-a587-39924007cb59 tempest-VolumesServicesTestJSON-40956285 None] Lock "cinder-279157e3-8407-4ea8-bb69-2c0de370c25f-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:08:02 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-f3677be3-a905-45ee-b3ef-5af8b8df5a07 req-b1896f23-88b3-4887-b326-f01a253c90f2 tempest-ServerActionsTestOtherA-1802890097 None] Terminate volume connection completed successfully. Sep 06 08:08:02 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-f3677be3-a905-45ee-b3ef-5af8b8df5a07 req-b1896f23-88b3-4887-b326-f01a253c90f2 tempest-ServerActionsTestOtherA-1802890097 None] Deleting attachment 5f33b2a0-123d-4803-a3c3-1f6dcbf6249c. {{(pid=87307) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 08:08:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-f3677be3-a905-45ee-b3ef-5af8b8df5a07 req-5f3e27b9-c482-47a2-b73a-fd17277b7e2f tempest-ServerActionsTestOtherA-1802890097 None] Acquiring lock "cinder-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-f3677be3-a905-45ee-b3ef-5af8b8df5a07 req-5f3e27b9-c482-47a2-b73a-fd17277b7e2f tempest-ServerActionsTestOtherA-1802890097 None] Lock "cinder-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-f3677be3-a905-45ee-b3ef-5af8b8df5a07 req-5f3e27b9-c482-47a2-b73a-fd17277b7e2f tempest-ServerActionsTestOtherA-1802890097 None] Acquiring lock "cinder-quobyte-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-f3677be3-a905-45ee-b3ef-5af8b8df5a07 req-5f3e27b9-c482-47a2-b73a-fd17277b7e2f tempest-ServerActionsTestOtherA-1802890097 None] Lock "cinder-quobyte-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b" acquired by "delete_volume" :: waited 0.025s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:02 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dc21c8-24d7-407c-89bd-07df29e170a8]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:08:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-f3677be3-a905-45ee-b3ef-5af8b8df5a07 req-5f3e27b9-c482-47a2-b73a-fd17277b7e2f tempest-ServerActionsTestOtherA-1802890097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:02 devstack sudo[94284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b Sep 06 08:08:02 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:02 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-f3677be3-a905-45ee-b3ef-5af8b8df5a07 req-5f3e27b9-c482-47a2-b73a-fd17277b7e2f tempest-ServerActionsTestOtherA-1802890097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b" returned: 0 in 0.532s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-f3677be3-a905-45ee-b3ef-5af8b8df5a07 req-5f3e27b9-c482-47a2-b73a-fd17277b7e2f tempest-ServerActionsTestOtherA-1802890097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:02 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b Sep 06 08:08:02 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1d0fb603-46ae-49f8-9d17-11f0bf84bd0f tempest-ServerActionsTestOtherA-1802890097 None] Acquiring lock "cinder-fffb2711-ccc9-468f-85fa-047d1a562d37-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:03 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1d0fb603-46ae-49f8-9d17-11f0bf84bd0f tempest-ServerActionsTestOtherA-1802890097 None] Lock "cinder-fffb2711-ccc9-468f-85fa-047d1a562d37-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-f3677be3-a905-45ee-b3ef-5af8b8df5a07 req-5f3e27b9-c482-47a2-b73a-fd17277b7e2f tempest-ServerActionsTestOtherA-1802890097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b" returned: 0 in 0.437s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-f3677be3-a905-45ee-b3ef-5af8b8df5a07 req-5f3e27b9-c482-47a2-b73a-fd17277b7e2f tempest-ServerActionsTestOtherA-1802890097 None] Lock "cinder-quobyte-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b" released by "delete_volume" :: held 1.083s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:08:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1d0fb603-46ae-49f8-9d17-11f0bf84bd0f tempest-ServerActionsTestOtherA-1802890097 None] Acquiring lock "cinder-quobyte-fffb2711-ccc9-468f-85fa-047d1a562d37" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1d0fb603-46ae-49f8-9d17-11f0bf84bd0f tempest-ServerActionsTestOtherA-1802890097 None] Lock "cinder-quobyte-fffb2711-ccc9-468f-85fa-047d1a562d37" acquired by "delete_volume" :: waited 0.027s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:03 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f553a57-e85a-4626-a351-cfa91e679750]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:08:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1d0fb603-46ae-49f8-9d17-11f0bf84bd0f tempest-ServerActionsTestOtherA-1802890097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fffb2711-ccc9-468f-85fa-047d1a562d37 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:03 devstack cinder-volume[87307]: DEBUG cinder.quota [req-f3677be3-a905-45ee-b3ef-5af8b8df5a07 req-5f3e27b9-c482-47a2-b73a-fd17277b7e2f tempest-ServerActionsTestOtherA-1802890097 None] Created reservations ['44426013-64f4-4bf1-85e8-34f14e7a544c', 'dddd4b5b-f2d4-41c8-a682-76ea11ac08db', '76a5f255-240f-4593-b099-670b6fdb6f94', 'effd83b8-968b-442f-92b2-934d46fac39f'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:08:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-f3677be3-a905-45ee-b3ef-5af8b8df5a07 req-5f3e27b9-c482-47a2-b73a-fd17277b7e2f tempest-ServerActionsTestOtherA-1802890097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:08:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-f3677be3-a905-45ee-b3ef-5af8b8df5a07 req-5f3e27b9-c482-47a2-b73a-fd17277b7e2f tempest-ServerActionsTestOtherA-1802890097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:08:03 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [req-f3677be3-a905-45ee-b3ef-5af8b8df5a07 req-5f3e27b9-c482-47a2-b73a-fd17277b7e2f tempest-ServerActionsTestOtherA-1802890097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:08:03 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [req-f3677be3-a905-45ee-b3ef-5af8b8df5a07 req-5f3e27b9-c482-47a2-b73a-fd17277b7e2f tempest-ServerActionsTestOtherA-1802890097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:08:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-f3677be3-a905-45ee-b3ef-5af8b8df5a07 req-5f3e27b9-c482-47a2-b73a-fd17277b7e2f tempest-ServerActionsTestOtherA-1802890097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:08:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-f3677be3-a905-45ee-b3ef-5af8b8df5a07 req-5f3e27b9-c482-47a2-b73a-fd17277b7e2f tempest-ServerActionsTestOtherA-1802890097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:03 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fffb2711-ccc9-468f-85fa-047d1a562d37 Sep 06 08:08:03 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:03 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:08:03 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:04 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1d0fb603-46ae-49f8-9d17-11f0bf84bd0f tempest-ServerActionsTestOtherA-1802890097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fffb2711-ccc9-468f-85fa-047d1a562d37" returned: 0 in 0.563s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1d0fb603-46ae-49f8-9d17-11f0bf84bd0f tempest-ServerActionsTestOtherA-1802890097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fffb2711-ccc9-468f-85fa-047d1a562d37 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:04 devstack sudo[94305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fffb2711-ccc9-468f-85fa-047d1a562d37 Sep 06 08:08:04 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:04 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-f3677be3-a905-45ee-b3ef-5af8b8df5a07 req-5f3e27b9-c482-47a2-b73a-fd17277b7e2f tempest-ServerActionsTestOtherA-1802890097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.542s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:04 devstack cinder-volume[87307]: DEBUG cinder.manager [req-f3677be3-a905-45ee-b3ef-5af8b8df5a07 req-5f3e27b9-c482-47a2-b73a-fd17277b7e2f tempest-ServerActionsTestOtherA-1802890097 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:08:04 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-f3677be3-a905-45ee-b3ef-5af8b8df5a07 req-5f3e27b9-c482-47a2-b73a-fd17277b7e2f tempest-ServerActionsTestOtherA-1802890097 None] Deleted volume successfully. Sep 06 08:08:04 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-f3677be3-a905-45ee-b3ef-5af8b8df5a07 req-5f3e27b9-c482-47a2-b73a-fd17277b7e2f tempest-ServerActionsTestOtherA-1802890097 None] Lock "cinder-69ccbdb0-09ae-403b-aaea-8f9eb6d2cb5b-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:08:04 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1d0fb603-46ae-49f8-9d17-11f0bf84bd0f tempest-ServerActionsTestOtherA-1802890097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fffb2711-ccc9-468f-85fa-047d1a562d37" returned: 0 in 0.388s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:04 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1d0fb603-46ae-49f8-9d17-11f0bf84bd0f tempest-ServerActionsTestOtherA-1802890097 None] Lock "cinder-quobyte-fffb2711-ccc9-468f-85fa-047d1a562d37" released by "delete_volume" :: held 1.039s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:08:04 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-1d0fb603-46ae-49f8-9d17-11f0bf84bd0f tempest-ServerActionsTestOtherA-1802890097 None] Created reservations ['253ae3bc-3c2f-4a88-9819-7d7b8b3edd61', '3e7db5fc-d9a1-4b7c-b1db-63012d952ab2', 'db434b16-fbe5-4c14-b1e0-2dd20cf0309f', '2cbc1661-9236-4938-b1b8-7087655497a7'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:08:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1d0fb603-46ae-49f8-9d17-11f0bf84bd0f tempest-ServerActionsTestOtherA-1802890097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:08:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1d0fb603-46ae-49f8-9d17-11f0bf84bd0f tempest-ServerActionsTestOtherA-1802890097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:08:04 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1d0fb603-46ae-49f8-9d17-11f0bf84bd0f tempest-ServerActionsTestOtherA-1802890097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:08:04 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1d0fb603-46ae-49f8-9d17-11f0bf84bd0f tempest-ServerActionsTestOtherA-1802890097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:08:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1d0fb603-46ae-49f8-9d17-11f0bf84bd0f tempest-ServerActionsTestOtherA-1802890097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:08:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1d0fb603-46ae-49f8-9d17-11f0bf84bd0f tempest-ServerActionsTestOtherA-1802890097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:04 devstack sudo[94309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:08:04 devstack sudo[94309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:05 devstack sudo[94309]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1d0fb603-46ae-49f8-9d17-11f0bf84bd0f tempest-ServerActionsTestOtherA-1802890097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.384s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:05 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-1d0fb603-46ae-49f8-9d17-11f0bf84bd0f tempest-ServerActionsTestOtherA-1802890097 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:08:05 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-1d0fb603-46ae-49f8-9d17-11f0bf84bd0f tempest-ServerActionsTestOtherA-1802890097 None] Deleted volume successfully. Sep 06 08:08:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1d0fb603-46ae-49f8-9d17-11f0bf84bd0f tempest-ServerActionsTestOtherA-1802890097 None] Lock "cinder-fffb2711-ccc9-468f-85fa-047d1a562d37-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:08:11 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:08:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Flow 'volume_create_manager' (8b32e506-556a-44a6-9234-1a608f7bc606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:08:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17a8f0d1-4bce-46a5-bbe0-b6e414adadae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17a8f0d1-4bce-46a5-bbe0-b6e414adadae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1409681692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7df8eb62025b482a9ca9d0d0932db050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:08:12Z,use_quota=True,user_id='7d99aadaf2c04491b110cd56ae845071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18bad674-4fa9-4c16-a3f9-257aa3b5132f),volume_type_id=18bad674-4fa9-4c16-a3f9-257aa3b5132f)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (758c5b9b-9510-474e-b27d-62caf6ce9088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (758c5b9b-9510-474e-b27d-62caf6ce9088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86c2a16-c7a6-4e83-8ce7-b72cc3f9c761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86c2a16-c7a6-4e83-8ce7-b72cc3f9c761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7', 'volume_name': 'volume-1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f625c1-5545-465a-b30c-c316303035b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f625c1-5545-465a-b30c-c316303035b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2821876a-110e-4287-a7b4-ef53196bb46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:12 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Volume 1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7', 'volume_size': 1} Sep 06 08:08:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:08:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:08:12 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1409681692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7df8eb62025b482a9ca9d0d0932db050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:08:12Z,use_quota=True,user_id='7d99aadaf2c04491b110cd56ae845071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18bad674-4fa9-4c16-a3f9-257aa3b5132f),volume_type_id=18bad674-4fa9-4c16-a3f9-257aa3b5132f)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:08:12 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Creating volume 1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:08:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:08:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:08:12 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:08:12 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:08:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:08:12 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:08:12 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:08:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:12 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7 1073741824 Sep 06 08:08:12 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:12 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7 1073741824" returned: 0 in 0.884s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:13 devstack sudo[94434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7 Sep 06 08:08:13 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:13 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7" returned: 0 in 0.396s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:08:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:08:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2821876a-110e-4287-a7b4-ef53196bb46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da61fe1b-1d83-4d18-8dd0-98fac3de2d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:13 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Volume volume-1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7 (1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7): created successfully Sep 06 08:08:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da61fe1b-1d83-4d18-8dd0-98fac3de2d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Flow 'volume_create_manager' (8b32e506-556a-44a6-9234-1a608f7bc606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:08:13 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-383c92ed-2db1-4ac6-8de4-58c0277848c2 tempest-VolumeTypesAccessTest-105924475 None] Created volume successfully. Sep 06 08:08:14 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-30e7c8d3-80f9-44b5-b8d0-4952ec94b7f0 tempest-VolumeTypesAccessTest-105924475 None] Acquiring lock "cinder-1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:14 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-30e7c8d3-80f9-44b5-b8d0-4952ec94b7f0 tempest-VolumeTypesAccessTest-105924475 None] Lock "cinder-1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:14 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-30e7c8d3-80f9-44b5-b8d0-4952ec94b7f0 tempest-VolumeTypesAccessTest-105924475 None] Acquiring lock "cinder-quobyte-1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:14 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-30e7c8d3-80f9-44b5-b8d0-4952ec94b7f0 tempest-VolumeTypesAccessTest-105924475 None] Lock "cinder-quobyte-1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7" acquired by "delete_volume" :: waited 0.038s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:14 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35ce001-64c6-4729-aa13-318e136733f7]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:08:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-30e7c8d3-80f9-44b5-b8d0-4952ec94b7f0 tempest-VolumeTypesAccessTest-105924475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:14 devstack sudo[94438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7 Sep 06 08:08:14 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:15 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-30e7c8d3-80f9-44b5-b8d0-4952ec94b7f0 tempest-VolumeTypesAccessTest-105924475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7" returned: 0 in 0.451s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-30e7c8d3-80f9-44b5-b8d0-4952ec94b7f0 tempest-VolumeTypesAccessTest-105924475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:15 devstack sudo[94443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7 Sep 06 08:08:15 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:15 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-30e7c8d3-80f9-44b5-b8d0-4952ec94b7f0 tempest-VolumeTypesAccessTest-105924475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7" returned: 0 in 0.363s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:15 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-30e7c8d3-80f9-44b5-b8d0-4952ec94b7f0 tempest-VolumeTypesAccessTest-105924475 None] Lock "cinder-quobyte-1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7" released by "delete_volume" :: held 0.894s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:08:15 devstack cinder-volume[87307]: WARNING cinder.quota [None req-30e7c8d3-80f9-44b5-b8d0-4952ec94b7f0 tempest-VolumeTypesAccessTest-105924475 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-847846812 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-847846812, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:08:15 devstack cinder-volume[87307]: WARNING cinder.quota [None req-30e7c8d3-80f9-44b5-b8d0-4952ec94b7f0 tempest-VolumeTypesAccessTest-105924475 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-847846812 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-847846812, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:08:15 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-30e7c8d3-80f9-44b5-b8d0-4952ec94b7f0 tempest-VolumeTypesAccessTest-105924475 None] Created reservations ['5def1e81-269f-48dd-a4a1-61f02bda7b34', '34b1b5f2-181e-49a8-aa33-466a8542986f', '18614f6f-53f6-40a2-a59b-4b902a0184b1', '36c580fc-02c7-4891-8bbf-750f0a7af67b'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:08:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-30e7c8d3-80f9-44b5-b8d0-4952ec94b7f0 tempest-VolumeTypesAccessTest-105924475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:08:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-30e7c8d3-80f9-44b5-b8d0-4952ec94b7f0 tempest-VolumeTypesAccessTest-105924475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:08:15 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-30e7c8d3-80f9-44b5-b8d0-4952ec94b7f0 tempest-VolumeTypesAccessTest-105924475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:08:15 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-30e7c8d3-80f9-44b5-b8d0-4952ec94b7f0 tempest-VolumeTypesAccessTest-105924475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:08:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-30e7c8d3-80f9-44b5-b8d0-4952ec94b7f0 tempest-VolumeTypesAccessTest-105924475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:08:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-30e7c8d3-80f9-44b5-b8d0-4952ec94b7f0 tempest-VolumeTypesAccessTest-105924475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:15 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:08:15 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:16 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-30e7c8d3-80f9-44b5-b8d0-4952ec94b7f0 tempest-VolumeTypesAccessTest-105924475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.381s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:16 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-30e7c8d3-80f9-44b5-b8d0-4952ec94b7f0 tempest-VolumeTypesAccessTest-105924475 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:08:16 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-30e7c8d3-80f9-44b5-b8d0-4952ec94b7f0 tempest-VolumeTypesAccessTest-105924475 None] Deleted volume successfully. Sep 06 08:08:16 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-30e7c8d3-80f9-44b5-b8d0-4952ec94b7f0 tempest-VolumeTypesAccessTest-105924475 None] Lock "cinder-1c6d3a15-5b59-4df7-b6fc-de6fd3c7c5e7-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:08:25 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=102,cinder:UPDATE=107,cinder:INSERT=28,cinder:DELETE=10 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:08:26 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=100,cinder:UPDATE=114,cinder:DELETE=8,cinder:INSERT=27 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:08:29 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:08:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Flow 'volume_create_manager' (cd6b8adc-97da-4572-b176-3d928a941e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:08:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47daea3-ac51-4433-a55f-d1ec49d32e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47daea3-ac51-4433-a55f-d1ec49d32e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1661863592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9286d72e666748fdba22f5e226900542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:08:29Z,use_quota=True,user_id='5feaad8a1a324cf8a8a966e621f6a60a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1fd2b54-071c-477a-a295-5e5ce42ef516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1fd2b54-071c-477a-a295-5e5ce42ef516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c40b487-e420-44f4-8d70-623d977b7a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c40b487-e420-44f4-8d70-623d977b7a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2', 'volume_name': 'volume-bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be568f82-6932-4ea2-a828-131da408611b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be568f82-6932-4ea2-a828-131da408611b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c3a175-4b49-4127-9c56-5700eb5b07f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:29 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Volume bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2', 'volume_size': 1} Sep 06 08:08:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:08:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:08:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1661863592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9286d72e666748fdba22f5e226900542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:08:29Z,use_quota=True,user_id='5feaad8a1a324cf8a8a966e621f6a60a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:08:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Creating volume bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:08:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:08:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:08:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:08:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:08:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:08:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:08:29 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:08:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:29 devstack sudo[94493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2 1073741824 Sep 06 08:08:29 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:29 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2 1073741824" returned: 0 in 0.550s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:29 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2 Sep 06 08:08:29 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:30 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2" returned: 0 in 0.343s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:30 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:08:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:08:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c3a175-4b49-4127-9c56-5700eb5b07f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533f9fb8-dd7e-47eb-92d4-18990841786b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:30 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Volume volume-bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2 (bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2): created successfully Sep 06 08:08:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533f9fb8-dd7e-47eb-92d4-18990841786b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Flow 'volume_create_manager' (cd6b8adc-97da-4572-b176-3d928a941e94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:08:30 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-b938995a-7be4-489f-a5b4-293d6543e043 tempest-AbsoluteLimitsTests-1843704621 None] Created volume successfully. Sep 06 08:08:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3e261d89-5126-4541-ac6c-a4e9c78238fd tempest-AbsoluteLimitsTests-1843704621 None] Acquiring lock "cinder-bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3e261d89-5126-4541-ac6c-a4e9c78238fd tempest-AbsoluteLimitsTests-1843704621 None] Lock "cinder-bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3e261d89-5126-4541-ac6c-a4e9c78238fd tempest-AbsoluteLimitsTests-1843704621 None] Acquiring lock "cinder-quobyte-bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3e261d89-5126-4541-ac6c-a4e9c78238fd tempest-AbsoluteLimitsTests-1843704621 None] Lock "cinder-quobyte-bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2" acquired by "delete_volume" :: waited 0.028s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:31 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f963529e-a4b7-4874-9f48-02b93fbda86c]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:08:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3e261d89-5126-4541-ac6c-a4e9c78238fd tempest-AbsoluteLimitsTests-1843704621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:32 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2 Sep 06 08:08:32 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:32 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3e261d89-5126-4541-ac6c-a4e9c78238fd tempest-AbsoluteLimitsTests-1843704621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2" returned: 0 in 0.577s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3e261d89-5126-4541-ac6c-a4e9c78238fd tempest-AbsoluteLimitsTests-1843704621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:32 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2 Sep 06 08:08:32 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:33 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3e261d89-5126-4541-ac6c-a4e9c78238fd tempest-AbsoluteLimitsTests-1843704621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2" returned: 0 in 0.518s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3e261d89-5126-4541-ac6c-a4e9c78238fd tempest-AbsoluteLimitsTests-1843704621 None] Lock "cinder-quobyte-bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2" released by "delete_volume" :: held 1.177s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-3e261d89-5126-4541-ac6c-a4e9c78238fd tempest-AbsoluteLimitsTests-1843704621 None] Created reservations ['958f21b3-2c52-4d2c-8c93-5e9ee3808a38', '206dae45-cb46-43c0-a96f-a6b5e7bfabd3', '0847a85a-a791-4817-8406-2468cc82377b', '523492ed-36fb-4348-8511-14ee3650f724'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3e261d89-5126-4541-ac6c-a4e9c78238fd tempest-AbsoluteLimitsTests-1843704621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3e261d89-5126-4541-ac6c-a4e9c78238fd tempest-AbsoluteLimitsTests-1843704621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3e261d89-5126-4541-ac6c-a4e9c78238fd tempest-AbsoluteLimitsTests-1843704621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3e261d89-5126-4541-ac6c-a4e9c78238fd tempest-AbsoluteLimitsTests-1843704621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3e261d89-5126-4541-ac6c-a4e9c78238fd tempest-AbsoluteLimitsTests-1843704621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3e261d89-5126-4541-ac6c-a4e9c78238fd tempest-AbsoluteLimitsTests-1843704621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:33 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:08:33 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Flow 'volume_create_manager' (a9003450-a820-451a-8080-bf541b0350ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7478c2c4-ab39-4f96-b979-8803d460d586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7478c2c4-ab39-4f96-b979-8803d460d586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-482879112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3675d614-c390-4647-a686-9abb8744f3c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5488076dcfc4692ad3bceffc57fe9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:08:34Z,use_quota=True,user_id='2b787ad5734e455bb6216b97cb010bcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa8eb459-886c-44cf-8cfe-2e5c9f3a0046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa8eb459-886c-44cf-8cfe-2e5c9f3a0046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1722e9a6-acb2-4f31-9271-d47e8125d85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1722e9a6-acb2-4f31-9271-d47e8125d85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3675d614-c390-4647-a686-9abb8744f3c4', 'volume_name': 'volume-3675d614-c390-4647-a686-9abb8744f3c4', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:33 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4da03c22-d245-43d1-808f-752fe1db4a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4da03c22-d245-43d1-808f-752fe1db4a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (883731d5-84b7-4763-ad15-8bc84f0f9ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:33 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Volume 3675d614-c390-4647-a686-9abb8744f3c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3675d614-c390-4647-a686-9abb8744f3c4', 'volume_size': 1} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-482879112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3675d614-c390-4647-a686-9abb8744f3c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5488076dcfc4692ad3bceffc57fe9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:08:34Z,use_quota=True,user_id='2b787ad5734e455bb6216b97cb010bcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Creating volume 3675d614-c390-4647-a686-9abb8744f3c4 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:08:33 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3e261d89-5126-4541-ac6c-a4e9c78238fd tempest-AbsoluteLimitsTests-1843704621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.578s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-3e261d89-5126-4541-ac6c-a4e9c78238fd tempest-AbsoluteLimitsTests-1843704621 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:08:33 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-3e261d89-5126-4541-ac6c-a4e9c78238fd tempest-AbsoluteLimitsTests-1843704621 None] Deleted volume successfully. Sep 06 08:08:33 devstack sudo[94513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4 1073741824 Sep 06 08:08:33 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3e261d89-5126-4541-ac6c-a4e9c78238fd tempest-AbsoluteLimitsTests-1843704621 None] Lock "cinder-bfa4d58c-b9c1-423d-b732-9b42f6a3c9b2-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:08:33 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:34 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4 1073741824" returned: 0 in 0.542s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:34 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4 Sep 06 08:08:34 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:34 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4" returned: 0 in 0.298s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:08:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:08:34 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (883731d5-84b7-4763-ad15-8bc84f0f9ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3675d614-c390-4647-a686-9abb8744f3c4', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:34 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada56215-fc65-4010-ba1f-c3722f1fc2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:34 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Volume volume-3675d614-c390-4647-a686-9abb8744f3c4 (3675d614-c390-4647-a686-9abb8744f3c4): created successfully Sep 06 08:08:34 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada56215-fc65-4010-ba1f-c3722f1fc2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:34 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Flow 'volume_create_manager' (a9003450-a820-451a-8080-bf541b0350ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:08:34 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-1ebb48c7-6577-41e9-a6ab-c1ceedba9c55 tempest-SnapshotMetadataTestJSON-2008187542 None] Created volume successfully. Sep 06 08:08:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-eda1cf81-1a74-4c43-bcc3-1e704246db15 tempest-SnapshotMetadataTestJSON-2008187542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:08:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-eda1cf81-1a74-4c43-bcc3-1e704246db15 tempest-SnapshotMetadataTestJSON-2008187542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:08:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-eda1cf81-1a74-4c43-bcc3-1e704246db15 tempest-SnapshotMetadataTestJSON-2008187542 None] Creating offline snapshot 9f38c7db-62e0-4cf2-a2f8-637ce843a203 of volume 3675d614-c390-4647-a686-9abb8744f3c4 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:08:35 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc2c615-de69-4420-adc8-76d23b1d24e8]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:08:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eda1cf81-1a74-4c43-bcc3-1e704246db15 tempest-SnapshotMetadataTestJSON-2008187542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:36 devstack sudo[94525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4 Sep 06 08:08:36 devstack sudo[94525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:36 devstack sudo[94525]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eda1cf81-1a74-4c43-bcc3-1e704246db15 tempest-SnapshotMetadataTestJSON-2008187542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4" returned: 0 in 0.427s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eda1cf81-1a74-4c43-bcc3-1e704246db15 tempest-SnapshotMetadataTestJSON-2008187542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.9f38c7db-62e0-4cf2-a2f8-637ce843a203 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:36 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.9f38c7db-62e0-4cf2-a2f8-637ce843a203 1G Sep 06 08:08:36 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:37 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eda1cf81-1a74-4c43-bcc3-1e704246db15 tempest-SnapshotMetadataTestJSON-2008187542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.9f38c7db-62e0-4cf2-a2f8-637ce843a203 1G" returned: 0 in 0.656s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eda1cf81-1a74-4c43-bcc3-1e704246db15 tempest-SnapshotMetadataTestJSON-2008187542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3675d614-c390-4647-a686-9abb8744f3c4 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.9f38c7db-62e0-4cf2-a2f8-637ce843a203 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:37 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3675d614-c390-4647-a686-9abb8744f3c4 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.9f38c7db-62e0-4cf2-a2f8-637ce843a203 Sep 06 08:08:37 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:37 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:08:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Flow 'volume_create_manager' (093193ed-e2bb-46d5-87ef-0cb38fd42246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:08:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd245def-a2a3-4543-9756-4faefdcdb7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd245def-a2a3-4543-9756-4faefdcdb7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-527968257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a2f8f6-58c2-4991-b41f-e1a77c0a7813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c2ea92397c46ec91eb2dcebf9cd1e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:08:37Z,use_quota=True,user_id='0033a4af28c84efc85a423e04d743086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0b42d8c-d3e3-4220-844e-c9c202dd5f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0b42d8c-d3e3-4220-844e-c9c202dd5f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1356fb-c037-4316-a642-a1278f18385f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1356fb-c037-4316-a642-a1278f18385f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6a2f8f6-58c2-4991-b41f-e1a77c0a7813', 'volume_name': 'volume-d6a2f8f6-58c2-4991-b41f-e1a77c0a7813', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:37 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e2568e-0715-4b35-b416-a994ce0be28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e2568e-0715-4b35-b416-a994ce0be28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (007b9914-3efc-4b62-8490-1c28c4506e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:37 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Volume d6a2f8f6-58c2-4991-b41f-e1a77c0a7813: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6a2f8f6-58c2-4991-b41f-e1a77c0a7813', 'volume_size': 1} Sep 06 08:08:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:08:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eda1cf81-1a74-4c43-bcc3-1e704246db15 tempest-SnapshotMetadataTestJSON-2008187542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3675d614-c390-4647-a686-9abb8744f3c4 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.9f38c7db-62e0-4cf2-a2f8-637ce843a203" returned: 0 in 0.477s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:37 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-eda1cf81-1a74-4c43-bcc3-1e704246db15 tempest-SnapshotMetadataTestJSON-2008187542 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.9f38c7db-62e0-4cf2-a2f8-637ce843a203 is being set with open permissions: ugo+rw Sep 06 08:08:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eda1cf81-1a74-4c43-bcc3-1e704246db15 tempest-SnapshotMetadataTestJSON-2008187542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.9f38c7db-62e0-4cf2-a2f8-637ce843a203 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:37 devstack sudo[94553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.9f38c7db-62e0-4cf2-a2f8-637ce843a203 Sep 06 08:08:37 devstack sudo[94553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:37 devstack sudo[94553]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eda1cf81-1a74-4c43-bcc3-1e704246db15 tempest-SnapshotMetadataTestJSON-2008187542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.9f38c7db-62e0-4cf2-a2f8-637ce843a203" returned: 0 in 0.421s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eda1cf81-1a74-4c43-bcc3-1e704246db15 tempest-SnapshotMetadataTestJSON-2008187542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:38 devstack sudo[94564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.info Sep 06 08:08:38 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:38 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eda1cf81-1a74-4c43-bcc3-1e704246db15 tempest-SnapshotMetadataTestJSON-2008187542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.info" returned: 0 in 0.331s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:38 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-eda1cf81-1a74-4c43-bcc3-1e704246db15 tempest-SnapshotMetadataTestJSON-2008187542 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.info is being set with open permissions: ugo+rw Sep 06 08:08:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eda1cf81-1a74-4c43-bcc3-1e704246db15 tempest-SnapshotMetadataTestJSON-2008187542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:38 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.info Sep 06 08:08:38 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:38 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eda1cf81-1a74-4c43-bcc3-1e704246db15 tempest-SnapshotMetadataTestJSON-2008187542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.info" returned: 0 in 0.291s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-eda1cf81-1a74-4c43-bcc3-1e704246db15 tempest-SnapshotMetadataTestJSON-2008187542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.774s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:08:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.175s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:08:38 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-527968257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a2f8f6-58c2-4991-b41f-e1a77c0a7813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c2ea92397c46ec91eb2dcebf9cd1e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:08:37Z,use_quota=True,user_id='0033a4af28c84efc85a423e04d743086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:08:38 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Creating volume d6a2f8f6-58c2-4991-b41f-e1a77c0a7813 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:08:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:08:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:08:38 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:08:38 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:08:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:08:38 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:08:38 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:08:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6a2f8f6-58c2-4991-b41f-e1a77c0a7813 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:38 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6a2f8f6-58c2-4991-b41f-e1a77c0a7813 1073741824 Sep 06 08:08:38 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:38 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-eda1cf81-1a74-4c43-bcc3-1e704246db15 tempest-SnapshotMetadataTestJSON-2008187542 None] Create snapshot completed successfully Sep 06 08:08:39 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6a2f8f6-58c2-4991-b41f-e1a77c0a7813 1073741824" returned: 0 in 0.578s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6a2f8f6-58c2-4991-b41f-e1a77c0a7813 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:39 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6a2f8f6-58c2-4991-b41f-e1a77c0a7813 Sep 06 08:08:39 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:39 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6a2f8f6-58c2-4991-b41f-e1a77c0a7813" returned: 0 in 0.369s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:08:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:08:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (007b9914-3efc-4b62-8490-1c28c4506e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6a2f8f6-58c2-4991-b41f-e1a77c0a7813', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb83206b-8fcc-42e2-96c6-c26f064a8977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:39 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Volume volume-d6a2f8f6-58c2-4991-b41f-e1a77c0a7813 (d6a2f8f6-58c2-4991-b41f-e1a77c0a7813): created successfully Sep 06 08:08:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb83206b-8fcc-42e2-96c6-c26f064a8977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Flow 'volume_create_manager' (093193ed-e2bb-46d5-87ef-0cb38fd42246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:08:39 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-d9dfdc8a-b02b-4f32-b2bb-7e85dbab4e0a tempest-AttachVolumeNegativeTest-105042574 None] Created volume successfully. Sep 06 08:08:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-d73d93d1-1d67-4911-8ca9-9f258a4f7aec tempest-SnapshotMetadataTestJSON-2008187542 None] Acquiring lock "cinder-9f38c7db-62e0-4cf2-a2f8-637ce843a203-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-d73d93d1-1d67-4911-8ca9-9f258a4f7aec tempest-SnapshotMetadataTestJSON-2008187542 None] Lock "cinder-9f38c7db-62e0-4cf2-a2f8-637ce843a203-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-d73d93d1-1d67-4911-8ca9-9f258a4f7aec tempest-SnapshotMetadataTestJSON-2008187542 None] Acquiring lock "cinder-quobyte-3675d614-c390-4647-a686-9abb8744f3c4" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-d73d93d1-1d67-4911-8ca9-9f258a4f7aec tempest-SnapshotMetadataTestJSON-2008187542 None] Lock "cinder-quobyte-3675d614-c390-4647-a686-9abb8744f3c4" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-d73d93d1-1d67-4911-8ca9-9f258a4f7aec tempest-SnapshotMetadataTestJSON-2008187542 None] Acquiring lock "cinder-quobyte-9f38c7db-62e0-4cf2-a2f8-637ce843a203" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-d73d93d1-1d67-4911-8ca9-9f258a4f7aec tempest-SnapshotMetadataTestJSON-2008187542 None] Lock "cinder-quobyte-9f38c7db-62e0-4cf2-a2f8-637ce843a203" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-d73d93d1-1d67-4911-8ca9-9f258a4f7aec tempest-SnapshotMetadataTestJSON-2008187542 None] Deleting offline snapshot 9f38c7db-62e0-4cf2-a2f8-637ce843a203 of volume 3675d614-c390-4647-a686-9abb8744f3c4 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:08:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-d73d93d1-1d67-4911-8ca9-9f258a4f7aec tempest-SnapshotMetadataTestJSON-2008187542 None] snapshot_file for this snap is: volume-3675d614-c390-4647-a686-9abb8744f3c4.9f38c7db-62e0-4cf2-a2f8-637ce843a203 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:08:41 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3c9e78-cfb9-4b11-8a8f-ac19efb6d518]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:08:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d73d93d1-1d67-4911-8ca9-9f258a4f7aec tempest-SnapshotMetadataTestJSON-2008187542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.9f38c7db-62e0-4cf2-a2f8-637ce843a203 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:41 devstack sudo[94678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.9f38c7db-62e0-4cf2-a2f8-637ce843a203 Sep 06 08:08:41 devstack sudo[94678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:41 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:08:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Flow 'volume_create_manager' (5d0fc5d5-8b92-44e6-b7b6-287943d147ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:08:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a357db89-a708-460d-8fa0-8b0f873da27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a357db89-a708-460d-8fa0-8b0f873da27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1520122354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54faeb35-08aa-42a9-8edd-0836be32432e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd1818bcdd34b46b05f51d821e5ea6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:08:42Z,use_quota=True,user_id='818b3355584f4e3db47ab49a115bc87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (955dcddb-5dad-4e24-911e-0be8ffe35fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (955dcddb-5dad-4e24-911e-0be8ffe35fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e25b6d8-639f-44a9-b6d3-bc64b844ede7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e25b6d8-639f-44a9-b6d3-bc64b844ede7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54faeb35-08aa-42a9-8edd-0836be32432e', 'volume_name': 'volume-54faeb35-08aa-42a9-8edd-0836be32432e', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:41 devstack sudo[94678]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7150757-279c-45ad-bd36-e6aae9a75691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7150757-279c-45ad-bd36-e6aae9a75691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f015affb-86e3-4e4b-9cec-e64f8712bfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:42 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Volume 54faeb35-08aa-42a9-8edd-0836be32432e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54faeb35-08aa-42a9-8edd-0836be32432e', 'volume_size': 1} Sep 06 08:08:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:08:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:08:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1520122354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54faeb35-08aa-42a9-8edd-0836be32432e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd1818bcdd34b46b05f51d821e5ea6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:08:42Z,use_quota=True,user_id='818b3355584f4e3db47ab49a115bc87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:08:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Creating volume 54faeb35-08aa-42a9-8edd-0836be32432e {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:08:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:08:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:08:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:08:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:08:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:08:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:08:42 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:08:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d73d93d1-1d67-4911-8ca9-9f258a4f7aec tempest-SnapshotMetadataTestJSON-2008187542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.9f38c7db-62e0-4cf2-a2f8-637ce843a203" returned: 0 in 1.030s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-d73d93d1-1d67-4911-8ca9-9f258a4f7aec tempest-SnapshotMetadataTestJSON-2008187542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3675d614-c390-4647-a686-9abb8744f3c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:08:42 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e 1073741824 Sep 06 08:08:42 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:42 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dd1b68-6d3e-46fb-8272-cf490bb46dbd]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:08:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d73d93d1-1d67-4911-8ca9-9f258a4f7aec tempest-SnapshotMetadataTestJSON-2008187542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:42 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4 Sep 06 08:08:42 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-8b4c53da-6f44-49c0-a9ec-ecd3b40c1e27 req-77c7c897-a26e-4e13-a7e4-27448ababa0a tempest-AttachVolumeNegativeTest-105042574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:08:42 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d73d93d1-1d67-4911-8ca9-9f258a4f7aec tempest-SnapshotMetadataTestJSON-2008187542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4" returned: 0 in 0.689s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d73d93d1-1d67-4911-8ca9-9f258a4f7aec tempest-SnapshotMetadataTestJSON-2008187542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.9f38c7db-62e0-4cf2-a2f8-637ce843a203 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:42 devstack sudo[94715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.9f38c7db-62e0-4cf2-a2f8-637ce843a203 Sep 06 08:08:42 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:42 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e 1073741824" returned: 0 in 0.916s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:43 devstack sudo[94717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e Sep 06 08:08:43 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:43 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d73d93d1-1d67-4911-8ca9-9f258a4f7aec tempest-SnapshotMetadataTestJSON-2008187542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.9f38c7db-62e0-4cf2-a2f8-637ce843a203" returned: 0 in 0.464s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d73d93d1-1d67-4911-8ca9-9f258a4f7aec tempest-SnapshotMetadataTestJSON-2008187542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.9f38c7db-62e0-4cf2-a2f8-637ce843a203 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:43 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e" returned: 0 in 0.286s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:43 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:08:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:08:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-8b4c53da-6f44-49c0-a9ec-ecd3b40c1e27 req-77c7c897-a26e-4e13-a7e4-27448ababa0a tempest-AttachVolumeNegativeTest-105042574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.815s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:08:43 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.9f38c7db-62e0-4cf2-a2f8-637ce843a203 Sep 06 08:08:43 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f015affb-86e3-4e4b-9cec-e64f8712bfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54faeb35-08aa-42a9-8edd-0836be32432e', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5889d44-f6d2-4b3b-95cf-a86b89a22418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-8b4c53da-6f44-49c0-a9ec-ecd3b40c1e27 req-77c7c897-a26e-4e13-a7e4-27448ababa0a tempest-AttachVolumeNegativeTest-105042574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:08:43 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Volume volume-54faeb35-08aa-42a9-8edd-0836be32432e (54faeb35-08aa-42a9-8edd-0836be32432e): created successfully Sep 06 08:08:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5889d44-f6d2-4b3b-95cf-a86b89a22418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Flow 'volume_create_manager' (5d0fc5d5-8b92-44e6-b7b6-287943d147ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:08:43 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e7469603-e310-48eb-9ace-35a167ade5dc tempest-VolumesDeleteCascade-220040628 None] Created volume successfully. Sep 06 08:08:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-8b4c53da-6f44-49c0-a9ec-ecd3b40c1e27 req-77c7c897-a26e-4e13-a7e4-27448ababa0a tempest-AttachVolumeNegativeTest-105042574 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0', 'name': 'volume-d6a2f8f6-58c2-4991-b41f-e1a77c0a7813', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f379fd39-75ac-4565-a25a-585ef242c186', 'enforce_multipath': True} {{(pid=87307) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 08:08:43 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-8b4c53da-6f44-49c0-a9ec-ecd3b40c1e27 req-77c7c897-a26e-4e13-a7e4-27448ababa0a tempest-AttachVolumeNegativeTest-105042574 None] attachment_update completed successfully. Sep 06 08:08:43 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d73d93d1-1d67-4911-8ca9-9f258a4f7aec tempest-SnapshotMetadataTestJSON-2008187542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4.9f38c7db-62e0-4cf2-a2f8-637ce843a203" returned: 0 in 0.295s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-d73d93d1-1d67-4911-8ca9-9f258a4f7aec tempest-SnapshotMetadataTestJSON-2008187542 None] Lock "cinder-quobyte-9f38c7db-62e0-4cf2-a2f8-637ce843a203" released by "_delete_snapshot" :: held 2.730s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:08:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-d73d93d1-1d67-4911-8ca9-9f258a4f7aec tempest-SnapshotMetadataTestJSON-2008187542 None] Lock "cinder-quobyte-3675d614-c390-4647-a686-9abb8744f3c4" released by "delete_snapshot" :: held 2.799s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:08:43 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-d73d93d1-1d67-4911-8ca9-9f258a4f7aec tempest-SnapshotMetadataTestJSON-2008187542 None] Created reservations ['d31e0600-8c54-41bb-9084-9825c3e41adc', '2aba7de0-8bd2-4062-8fd4-eda02ee39b27', 'b332a968-1532-4f99-adec-06ccac69eecd', '346d87c5-cd4e-4b51-bd88-2b0199d4a607'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:08:43 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-d73d93d1-1d67-4911-8ca9-9f258a4f7aec tempest-SnapshotMetadataTestJSON-2008187542 None] Delete snapshot completed successfully. Sep 06 08:08:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-d73d93d1-1d67-4911-8ca9-9f258a4f7aec tempest-SnapshotMetadataTestJSON-2008187542 None] Lock "cinder-9f38c7db-62e0-4cf2-a2f8-637ce843a203-delete_snapshot" released by "delete_snapshot" :: held 2.999s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:08:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1c56591b-8252-4098-9543-b200f4ca3927 tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:08:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1c56591b-8252-4098-9543-b200f4ca3927 tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:08:44 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-1c56591b-8252-4098-9543-b200f4ca3927 tempest-VolumesDeleteCascade-220040628 None] Creating offline snapshot 65b61c6f-cf4b-4e82-af65-e516268d3ffa of volume 54faeb35-08aa-42a9-8edd-0836be32432e {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:08:44 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f60370-cd06-4d26-a0a6-4a085726b451]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:08:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1c56591b-8252-4098-9543-b200f4ca3927 tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:44 devstack sudo[95110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e Sep 06 08:08:44 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e86a424a-f4a3-4f4c-8a9e-88e60a360c72 tempest-SnapshotMetadataTestJSON-2008187542 None] Acquiring lock "cinder-3675d614-c390-4647-a686-9abb8744f3c4-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e86a424a-f4a3-4f4c-8a9e-88e60a360c72 tempest-SnapshotMetadataTestJSON-2008187542 None] Lock "cinder-3675d614-c390-4647-a686-9abb8744f3c4-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e86a424a-f4a3-4f4c-8a9e-88e60a360c72 tempest-SnapshotMetadataTestJSON-2008187542 None] Acquiring lock "cinder-quobyte-3675d614-c390-4647-a686-9abb8744f3c4" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e86a424a-f4a3-4f4c-8a9e-88e60a360c72 tempest-SnapshotMetadataTestJSON-2008187542 None] Lock "cinder-quobyte-3675d614-c390-4647-a686-9abb8744f3c4" acquired by "delete_volume" :: waited 0.031s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:44 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb9add5-3451-41ee-a7fb-d3b9e743dc2f]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:08:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e86a424a-f4a3-4f4c-8a9e-88e60a360c72 tempest-SnapshotMetadataTestJSON-2008187542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:44 devstack sudo[95113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4 Sep 06 08:08:44 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:44 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1c56591b-8252-4098-9543-b200f4ca3927 tempest-VolumesDeleteCascade-220040628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e" returned: 0 in 0.719s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1c56591b-8252-4098-9543-b200f4ca3927 tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:44 devstack sudo[95118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa 1G Sep 06 08:08:44 devstack sudo[95118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:45 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e86a424a-f4a3-4f4c-8a9e-88e60a360c72 tempest-SnapshotMetadataTestJSON-2008187542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4" returned: 0 in 0.531s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e86a424a-f4a3-4f4c-8a9e-88e60a360c72 tempest-SnapshotMetadataTestJSON-2008187542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:45 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4 Sep 06 08:08:45 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:45 devstack sudo[95118]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1c56591b-8252-4098-9543-b200f4ca3927 tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa 1G" returned: 0 in 0.604s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1c56591b-8252-4098-9543-b200f4ca3927 tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54faeb35-08aa-42a9-8edd-0836be32432e -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:45 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e86a424a-f4a3-4f4c-8a9e-88e60a360c72 tempest-SnapshotMetadataTestJSON-2008187542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3675d614-c390-4647-a686-9abb8744f3c4" returned: 0 in 0.358s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:45 devstack sudo[95129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54faeb35-08aa-42a9-8edd-0836be32432e -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa Sep 06 08:08:45 devstack sudo[95129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e86a424a-f4a3-4f4c-8a9e-88e60a360c72 tempest-SnapshotMetadataTestJSON-2008187542 None] Lock "cinder-quobyte-3675d614-c390-4647-a686-9abb8744f3c4" released by "delete_volume" :: held 1.067s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:08:45 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-e86a424a-f4a3-4f4c-8a9e-88e60a360c72 tempest-SnapshotMetadataTestJSON-2008187542 None] Created reservations ['e461c3fc-a3ca-40dd-aaaf-3d59d085400b', '46c7475f-1a16-49c4-9931-9c274e5a1bd5', 'c9b556a9-4ad5-47cc-8fdf-1292d4441184', '071321c2-aad6-4da5-90b8-092e0a0788dd'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:08:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e86a424a-f4a3-4f4c-8a9e-88e60a360c72 tempest-SnapshotMetadataTestJSON-2008187542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:08:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e86a424a-f4a3-4f4c-8a9e-88e60a360c72 tempest-SnapshotMetadataTestJSON-2008187542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:08:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e86a424a-f4a3-4f4c-8a9e-88e60a360c72 tempest-SnapshotMetadataTestJSON-2008187542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:08:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e86a424a-f4a3-4f4c-8a9e-88e60a360c72 tempest-SnapshotMetadataTestJSON-2008187542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:08:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e86a424a-f4a3-4f4c-8a9e-88e60a360c72 tempest-SnapshotMetadataTestJSON-2008187542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:08:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e86a424a-f4a3-4f4c-8a9e-88e60a360c72 tempest-SnapshotMetadataTestJSON-2008187542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:45 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:08:45 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:46 devstack sudo[95129]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1c56591b-8252-4098-9543-b200f4ca3927 tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54faeb35-08aa-42a9-8edd-0836be32432e -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa" returned: 0 in 0.642s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:46 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-1c56591b-8252-4098-9543-b200f4ca3927 tempest-VolumesDeleteCascade-220040628 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa is being set with open permissions: ugo+rw Sep 06 08:08:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1c56591b-8252-4098-9543-b200f4ca3927 tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:46 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa Sep 06 08:08:46 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:46 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e86a424a-f4a3-4f4c-8a9e-88e60a360c72 tempest-SnapshotMetadataTestJSON-2008187542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.513s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:46 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-e86a424a-f4a3-4f4c-8a9e-88e60a360c72 tempest-SnapshotMetadataTestJSON-2008187542 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:08:46 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e86a424a-f4a3-4f4c-8a9e-88e60a360c72 tempest-SnapshotMetadataTestJSON-2008187542 None] Deleted volume successfully. Sep 06 08:08:46 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e86a424a-f4a3-4f4c-8a9e-88e60a360c72 tempest-SnapshotMetadataTestJSON-2008187542 None] Lock "cinder-3675d614-c390-4647-a686-9abb8744f3c4-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:08:46 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1c56591b-8252-4098-9543-b200f4ca3927 tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa" returned: 0 in 0.373s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1c56591b-8252-4098-9543-b200f4ca3927 tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:46 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.info Sep 06 08:08:46 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:46 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-175a842b-8ec8-4009-aca4-5afc649103c5 req-6fd404ad-a7cd-4b2e-bc8f-20f7e3a2c0ae tempest-AttachVolumeNegativeTest-105042574 None] Terminate volume connection completed successfully. Sep 06 08:08:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-175a842b-8ec8-4009-aca4-5afc649103c5 req-6fd404ad-a7cd-4b2e-bc8f-20f7e3a2c0ae tempest-AttachVolumeNegativeTest-105042574 None] Deleting attachment f379fd39-75ac-4565-a25a-585ef242c186. {{(pid=87307) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 08:08:46 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1c56591b-8252-4098-9543-b200f4ca3927 tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.info" returned: 0 in 0.359s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:46 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-1c56591b-8252-4098-9543-b200f4ca3927 tempest-VolumesDeleteCascade-220040628 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.info is being set with open permissions: ugo+rw Sep 06 08:08:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1c56591b-8252-4098-9543-b200f4ca3927 tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:47 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.info Sep 06 08:08:47 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:47 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1c56591b-8252-4098-9543-b200f4ca3927 tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.info" returned: 0 in 0.377s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1c56591b-8252-4098-9543-b200f4ca3927 tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.284s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:08:47 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-1c56591b-8252-4098-9543-b200f4ca3927 tempest-VolumesDeleteCascade-220040628 None] Create snapshot completed successfully Sep 06 08:08:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f29c46dd-02bc-4d20-b4a8-8bdf36070b6d tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:08:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f29c46dd-02bc-4d20-b4a8-8bdf36070b6d tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:08:48 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f29c46dd-02bc-4d20-b4a8-8bdf36070b6d tempest-VolumesDeleteCascade-220040628 None] Creating offline snapshot afbbbca5-065a-470e-9a6f-04bf3e2d70bb of volume 54faeb35-08aa-42a9-8edd-0836be32432e {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:08:49 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df04393-9314-4b2a-9698-fffc808c30fa]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:08:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f29c46dd-02bc-4d20-b4a8-8bdf36070b6d tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:49 devstack sudo[95207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa Sep 06 08:08:49 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:49 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f29c46dd-02bc-4d20-b4a8-8bdf36070b6d tempest-VolumesDeleteCascade-220040628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa" returned: 0 in 0.859s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:49 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f29c46dd-02bc-4d20-b4a8-8bdf36070b6d tempest-VolumesDeleteCascade-220040628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54faeb35-08aa-42a9-8edd-0836be32432e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:08:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f29c46dd-02bc-4d20-b4a8-8bdf36070b6d tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:49 devstack sudo[95224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb 1G Sep 06 08:08:49 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:50 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f29c46dd-02bc-4d20-b4a8-8bdf36070b6d tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb 1G" returned: 0 in 0.670s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f29c46dd-02bc-4d20-b4a8-8bdf36070b6d tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:50 devstack sudo[95233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb Sep 06 08:08:50 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:51 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f29c46dd-02bc-4d20-b4a8-8bdf36070b6d tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb" returned: 0 in 0.547s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:51 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-f29c46dd-02bc-4d20-b4a8-8bdf36070b6d tempest-VolumesDeleteCascade-220040628 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb is being set with open permissions: ugo+rw Sep 06 08:08:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f29c46dd-02bc-4d20-b4a8-8bdf36070b6d tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:51 devstack sudo[95239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb Sep 06 08:08:51 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:51 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f29c46dd-02bc-4d20-b4a8-8bdf36070b6d tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb" returned: 0 in 0.579s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f29c46dd-02bc-4d20-b4a8-8bdf36070b6d tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.836s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:08:51 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f29c46dd-02bc-4d20-b4a8-8bdf36070b6d tempest-VolumesDeleteCascade-220040628 None] Create snapshot completed successfully Sep 06 08:08:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "cinder-54faeb35-08aa-42a9-8edd-0836be32432e-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-54faeb35-08aa-42a9-8edd-0836be32432e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:52 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Performing cascade delete. {{(pid=87307) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 06 08:08:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "cinder-65b61c6f-cf4b-4e82-af65-e516268d3ffa-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-65b61c6f-cf4b-4e82-af65-e516268d3ffa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "cinder-quobyte-54faeb35-08aa-42a9-8edd-0836be32432e" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-quobyte-54faeb35-08aa-42a9-8edd-0836be32432e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "cinder-quobyte-65b61c6f-cf4b-4e82-af65-e516268d3ffa" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-quobyte-65b61c6f-cf4b-4e82-af65-e516268d3ffa" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:52 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Deleting offline snapshot 65b61c6f-cf4b-4e82-af65-e516268d3ffa of volume 54faeb35-08aa-42a9-8edd-0836be32432e {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:08:52 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] snapshot_file for this snap is: volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:08:52 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[178d2409-73dd-48f6-b32e-2e1c9c67aa16]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:08:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:52 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa Sep 06 08:08:52 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:53 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa" returned: 0 in 0.557s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54faeb35-08aa-42a9-8edd-0836be32432e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:08:53 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8c024c-719a-487e-b794-47f3f09d7359]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:08:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:53 devstack sudo[95251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e Sep 06 08:08:53 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:54 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e" returned: 0 in 0.956s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:54 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[113fc833-e5c2-4233-bf31-43ca0a5bfaae]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:08:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:54 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb Sep 06 08:08:54 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:55 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb" returned: 0 in 0.823s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54faeb35-08aa-42a9-8edd-0836be32432e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0ecfea-bb27-44cb-8bff-31a641ffd8c2]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:55 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa Sep 06 08:08:55 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Flow 'volume_create_manager' (3787474f-5fd4-499f-b43b-f86864548896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be731fbf-8086-4e2b-af8f-96ec0fb5928d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be731fbf-8086-4e2b-af8f-96ec0fb5928d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1730747191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6f6041f-a425-45a6-ae71-bb5a326b06bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='634917840dce43879ff652df5d7dd420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:08:56Z,use_quota=True,user_id='ccc285224288445595a2e4d55daf48ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63f6d49-0e65-4890-9cce-97731023591c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63f6d49-0e65-4890-9cce-97731023591c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63036a95-387f-46cd-959e-a8c19fb5a561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63036a95-387f-46cd-959e-a8c19fb5a561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6f6041f-a425-45a6-ae71-bb5a326b06bb', 'volume_name': 'volume-f6f6041f-a425-45a6-ae71-bb5a326b06bb', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab237bb8-f4a3-4dd3-a51b-d4ef266d699d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab237bb8-f4a3-4dd3-a51b-d4ef266d699d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9586f5b9-e86a-46b5-9763-e24c2e6f705c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:55 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Volume f6f6041f-a425-45a6-ae71-bb5a326b06bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6f6041f-a425-45a6-ae71-bb5a326b06bb', 'volume_size': 1} Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1730747191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6f6041f-a425-45a6-ae71-bb5a326b06bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='634917840dce43879ff652df5d7dd420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:08:56Z,use_quota=True,user_id='ccc285224288445595a2e4d55daf48ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Creating volume f6f6041f-a425-45a6-ae71-bb5a326b06bb {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:08:55 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:08:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6f6041f-a425-45a6-ae71-bb5a326b06bb 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:55 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6f6041f-a425-45a6-ae71-bb5a326b06bb 1073741824 Sep 06 08:08:55 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:56 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa" returned: 0 in 0.927s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54faeb35-08aa-42a9-8edd-0836be32432e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:08:56 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e69567-1ad4-4c61-bc4f-0106dd44057b]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:08:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-76cd5c83-153e-4aba-b8eb-b439d8211c2f tempest-AttachVolumeNegativeTest-105042574 None] Acquiring lock "cinder-d6a2f8f6-58c2-4991-b41f-e1a77c0a7813-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-76cd5c83-153e-4aba-b8eb-b439d8211c2f tempest-AttachVolumeNegativeTest-105042574 None] Lock "cinder-d6a2f8f6-58c2-4991-b41f-e1a77c0a7813-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-76cd5c83-153e-4aba-b8eb-b439d8211c2f tempest-AttachVolumeNegativeTest-105042574 None] Acquiring lock "cinder-quobyte-d6a2f8f6-58c2-4991-b41f-e1a77c0a7813" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:56 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e Sep 06 08:08:56 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-76cd5c83-153e-4aba-b8eb-b439d8211c2f tempest-AttachVolumeNegativeTest-105042574 None] Lock "cinder-quobyte-d6a2f8f6-58c2-4991-b41f-e1a77c0a7813" acquired by "delete_volume" :: waited 0.047s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:56 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56ffd7e-6a13-4615-8a66-5569792c4a5e]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:08:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-76cd5c83-153e-4aba-b8eb-b439d8211c2f tempest-AttachVolumeNegativeTest-105042574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6a2f8f6-58c2-4991-b41f-e1a77c0a7813 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:56 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6a2f8f6-58c2-4991-b41f-e1a77c0a7813 Sep 06 08:08:56 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:56 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6f6041f-a425-45a6-ae71-bb5a326b06bb 1073741824" returned: 0 in 0.982s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6f6041f-a425-45a6-ae71-bb5a326b06bb {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:56 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e" returned: 0 in 0.691s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:56 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6f6041f-a425-45a6-ae71-bb5a326b06bb Sep 06 08:08:56 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:57 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa Sep 06 08:08:57 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:57 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-76cd5c83-153e-4aba-b8eb-b439d8211c2f tempest-AttachVolumeNegativeTest-105042574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6a2f8f6-58c2-4991-b41f-e1a77c0a7813" returned: 0 in 0.684s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-76cd5c83-153e-4aba-b8eb-b439d8211c2f tempest-AttachVolumeNegativeTest-105042574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6a2f8f6-58c2-4991-b41f-e1a77c0a7813 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:57 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6a2f8f6-58c2-4991-b41f-e1a77c0a7813 Sep 06 08:08:57 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:57 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6f6041f-a425-45a6-ae71-bb5a326b06bb" returned: 0 in 0.449s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:08:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:08:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9586f5b9-e86a-46b5-9763-e24c2e6f705c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6f6041f-a425-45a6-ae71-bb5a326b06bb', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73af9018-44ff-4e8a-9e3a-f63b6cfe2d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:08:57 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Volume volume-f6f6041f-a425-45a6-ae71-bb5a326b06bb (f6f6041f-a425-45a6-ae71-bb5a326b06bb): created successfully Sep 06 08:08:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73af9018-44ff-4e8a-9e3a-f63b6cfe2d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:08:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Flow 'volume_create_manager' (3787474f-5fd4-499f-b43b-f86864548896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:08:57 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-254e6264-a90b-430f-8e92-d30a178bb867 tempest-VolumesMetadataTest-1952619508 None] Created volume successfully. Sep 06 08:08:57 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa" returned: 0 in 0.688s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:57 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa Sep 06 08:08:57 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:57 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-76cd5c83-153e-4aba-b8eb-b439d8211c2f tempest-AttachVolumeNegativeTest-105042574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6a2f8f6-58c2-4991-b41f-e1a77c0a7813" returned: 0 in 0.523s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-76cd5c83-153e-4aba-b8eb-b439d8211c2f tempest-AttachVolumeNegativeTest-105042574 None] Lock "cinder-quobyte-d6a2f8f6-58c2-4991-b41f-e1a77c0a7813" released by "delete_volume" :: held 1.281s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:08:57 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-76cd5c83-153e-4aba-b8eb-b439d8211c2f tempest-AttachVolumeNegativeTest-105042574 None] Created reservations ['72ac384b-8d56-4c33-bb89-419036292561', 'a2c5d5c8-bd83-471c-b61d-78e693b6ec0f', 'a6f3c7dc-f33b-4248-a7c4-6d5b1ff925a0', '2461d6fe-7df0-461d-9e47-b8b685527d4a'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:08:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-76cd5c83-153e-4aba-b8eb-b439d8211c2f tempest-AttachVolumeNegativeTest-105042574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:08:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-76cd5c83-153e-4aba-b8eb-b439d8211c2f tempest-AttachVolumeNegativeTest-105042574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:08:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-76cd5c83-153e-4aba-b8eb-b439d8211c2f tempest-AttachVolumeNegativeTest-105042574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:08:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-76cd5c83-153e-4aba-b8eb-b439d8211c2f tempest-AttachVolumeNegativeTest-105042574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:08:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-76cd5c83-153e-4aba-b8eb-b439d8211c2f tempest-AttachVolumeNegativeTest-105042574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:08:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-76cd5c83-153e-4aba-b8eb-b439d8211c2f tempest-AttachVolumeNegativeTest-105042574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:58 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:08:58 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:58 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.65b61c6f-cf4b-4e82-af65-e516268d3ffa" returned: 0 in 0.376s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54faeb35-08aa-42a9-8edd-0836be32432e /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb -F qcow2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:58 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54faeb35-08aa-42a9-8edd-0836be32432e /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb -F qcow2 Sep 06 08:08:58 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:58 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-76cd5c83-153e-4aba-b8eb-b439d8211c2f tempest-AttachVolumeNegativeTest-105042574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.312s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:58 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-76cd5c83-153e-4aba-b8eb-b439d8211c2f tempest-AttachVolumeNegativeTest-105042574 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:08:58 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-76cd5c83-153e-4aba-b8eb-b439d8211c2f tempest-AttachVolumeNegativeTest-105042574 None] Deleted volume successfully. Sep 06 08:08:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-76cd5c83-153e-4aba-b8eb-b439d8211c2f tempest-AttachVolumeNegativeTest-105042574 None] Lock "cinder-d6a2f8f6-58c2-4991-b41f-e1a77c0a7813-delete_volume" released by "delete_volume" :: held 2.072s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:08:58 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54faeb35-08aa-42a9-8edd-0836be32432e /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb -F qcow2" returned: 0 in 0.503s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-quobyte-65b61c6f-cf4b-4e82-af65-e516268d3ffa" released by "_delete_snapshot" :: held 5.925s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:08:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-quobyte-54faeb35-08aa-42a9-8edd-0836be32432e" released by "delete_snapshot" :: held 5.976s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:08:58 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Created reservations ['1deb19a9-05ad-4530-83b4-e6795ffff4e1', 'f4f65b18-a8cc-4f27-9994-b234ae821d97', 'f22197ba-11ab-46e3-bc60-2f55bd5c0cae', 'ebf99f7d-6366-4628-aeee-57b466d42d2d'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:08:58 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Delete snapshot completed successfully. Sep 06 08:08:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-65b61c6f-cf4b-4e82-af65-e516268d3ffa-delete_snapshot" released by "delete_snapshot" :: held 6.223s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:08:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "cinder-afbbbca5-065a-470e-9a6f-04bf3e2d70bb-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-afbbbca5-065a-470e-9a6f-04bf3e2d70bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "cinder-quobyte-54faeb35-08aa-42a9-8edd-0836be32432e" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-quobyte-54faeb35-08aa-42a9-8edd-0836be32432e" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "cinder-quobyte-afbbbca5-065a-470e-9a6f-04bf3e2d70bb" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-quobyte-afbbbca5-065a-470e-9a6f-04bf3e2d70bb" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:58 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Deleting offline snapshot afbbbca5-065a-470e-9a6f-04bf3e2d70bb of volume 54faeb35-08aa-42a9-8edd-0836be32432e {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:08:58 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] snapshot_file for this snap is: volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bc0cd841-e259-4249-b903-488741f7a325 tempest-AttachVolumeNegativeTest-105042574 None] Acquiring lock "cinder-9eb0125f-4485-4503-8983-3985408e4cef-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e604cc-3505-4ea5-bfb7-428ddc5e45e8]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bc0cd841-e259-4249-b903-488741f7a325 tempest-AttachVolumeNegativeTest-105042574 None] Lock "cinder-9eb0125f-4485-4503-8983-3985408e4cef-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bc0cd841-e259-4249-b903-488741f7a325 tempest-AttachVolumeNegativeTest-105042574 None] Acquiring lock "cinder-quobyte-9eb0125f-4485-4503-8983-3985408e4cef" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bc0cd841-e259-4249-b903-488741f7a325 tempest-AttachVolumeNegativeTest-105042574 None] Lock "cinder-quobyte-9eb0125f-4485-4503-8983-3985408e4cef" acquired by "delete_volume" :: waited 0.026s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d5e155-fbbf-407e-9d67-be6c1adfd8b5]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc0cd841-e259-4249-b903-488741f7a325 tempest-AttachVolumeNegativeTest-105042574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9eb0125f-4485-4503-8983-3985408e4cef {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:59 devstack sudo[95404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb Sep 06 08:08:59 devstack sudo[95404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:59 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9eb0125f-4485-4503-8983-3985408e4cef Sep 06 08:08:59 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-851dfd56-2755-4e14-ab7b-d797f9ff1394 tempest-VolumesMetadataTest-1952619508 None] Acquiring lock "cinder-f6f6041f-a425-45a6-ae71-bb5a326b06bb-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-851dfd56-2755-4e14-ab7b-d797f9ff1394 tempest-VolumesMetadataTest-1952619508 None] Lock "cinder-f6f6041f-a425-45a6-ae71-bb5a326b06bb-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-851dfd56-2755-4e14-ab7b-d797f9ff1394 tempest-VolumesMetadataTest-1952619508 None] Acquiring lock "cinder-quobyte-f6f6041f-a425-45a6-ae71-bb5a326b06bb" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:08:59 devstack sudo[95404]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb" returned: 0 in 0.700s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54faeb35-08aa-42a9-8edd-0836be32432e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:08:59 devstack sudo[95412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:08:59 devstack sudo[95412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-851dfd56-2755-4e14-ab7b-d797f9ff1394 tempest-VolumesMetadataTest-1952619508 None] Lock "cinder-quobyte-f6f6041f-a425-45a6-ae71-bb5a326b06bb" acquired by "delete_volume" :: waited 0.048s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71b25b6-d455-4a02-b18c-ef68e0ebc37b]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cfc805-03f5-4802-bb56-c335d74524a9]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-851dfd56-2755-4e14-ab7b-d797f9ff1394 tempest-VolumesMetadataTest-1952619508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6f6041f-a425-45a6-ae71-bb5a326b06bb {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:08:59 devstack sudo[95415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e Sep 06 08:08:59 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:08:59 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc0cd841-e259-4249-b903-488741f7a325 tempest-AttachVolumeNegativeTest-105042574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9eb0125f-4485-4503-8983-3985408e4cef" returned: 0 in 0.758s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:08:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc0cd841-e259-4249-b903-488741f7a325 tempest-AttachVolumeNegativeTest-105042574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9eb0125f-4485-4503-8983-3985408e4cef {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:00 devstack sudo[95416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6f6041f-a425-45a6-ae71-bb5a326b06bb Sep 06 08:09:00 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:00 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9eb0125f-4485-4503-8983-3985408e4cef Sep 06 08:09:00 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:00 devstack sudo[95412]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.426s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager._thread_info {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread count: 28 {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread info: [<_MainThread(MainThread, started 139985167040640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:09:00 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e" returned: 0 in 0.490s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:00 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb Sep 06 08:09:00 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:00 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-851dfd56-2755-4e14-ab7b-d797f9ff1394 tempest-VolumesMetadataTest-1952619508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6f6041f-a425-45a6-ae71-bb5a326b06bb" returned: 0 in 0.550s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-851dfd56-2755-4e14-ab7b-d797f9ff1394 tempest-VolumesMetadataTest-1952619508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6f6041f-a425-45a6-ae71-bb5a326b06bb {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:00 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc0cd841-e259-4249-b903-488741f7a325 tempest-AttachVolumeNegativeTest-105042574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9eb0125f-4485-4503-8983-3985408e4cef" returned: 0 in 0.415s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:00 devstack sudo[95434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6f6041f-a425-45a6-ae71-bb5a326b06bb Sep 06 08:09:00 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bc0cd841-e259-4249-b903-488741f7a325 tempest-AttachVolumeNegativeTest-105042574 None] Lock "cinder-quobyte-9eb0125f-4485-4503-8983-3985408e4cef" released by "delete_volume" :: held 1.265s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-bc0cd841-e259-4249-b903-488741f7a325 tempest-AttachVolumeNegativeTest-105042574 None] Created reservations ['efb35deb-9bad-44e4-960b-ceab341b79c5', '6ada490d-3780-4087-bdaa-4bf234698f07', '967ae8ac-d1f0-4fa9-b8c5-c8dd1b06ac72', 'fc896c10-fde7-411d-b267-2c23c47ffa1c'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bc0cd841-e259-4249-b903-488741f7a325 tempest-AttachVolumeNegativeTest-105042574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bc0cd841-e259-4249-b903-488741f7a325 tempest-AttachVolumeNegativeTest-105042574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bc0cd841-e259-4249-b903-488741f7a325 tempest-AttachVolumeNegativeTest-105042574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bc0cd841-e259-4249-b903-488741f7a325 tempest-AttachVolumeNegativeTest-105042574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bc0cd841-e259-4249-b903-488741f7a325 tempest-AttachVolumeNegativeTest-105042574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc0cd841-e259-4249-b903-488741f7a325 tempest-AttachVolumeNegativeTest-105042574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:00 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:09:00 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:00 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-851dfd56-2755-4e14-ab7b-d797f9ff1394 tempest-VolumesMetadataTest-1952619508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f6f6041f-a425-45a6-ae71-bb5a326b06bb" returned: 0 in 0.326s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:00 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb" returned: 0 in 0.453s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-851dfd56-2755-4e14-ab7b-d797f9ff1394 tempest-VolumesMetadataTest-1952619508 None] Lock "cinder-quobyte-f6f6041f-a425-45a6-ae71-bb5a326b06bb" released by "delete_volume" :: held 0.982s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:00 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb Sep 06 08:09:00 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-851dfd56-2755-4e14-ab7b-d797f9ff1394 tempest-VolumesMetadataTest-1952619508 None] Created reservations ['481f55ed-63f9-4e96-9f37-a5aa8b165e02', 'f9772280-5c37-4540-9e67-f9ae768b7ec4', '17e37c48-8810-4f9c-8986-8117ca26f3e0', '4c487fd3-6f52-45db-a1e6-e6d97343c7ed'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:09:00 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc0cd841-e259-4249-b903-488741f7a325 tempest-AttachVolumeNegativeTest-105042574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.326s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-bc0cd841-e259-4249-b903-488741f7a325 tempest-AttachVolumeNegativeTest-105042574 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-851dfd56-2755-4e14-ab7b-d797f9ff1394 tempest-VolumesMetadataTest-1952619508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-851dfd56-2755-4e14-ab7b-d797f9ff1394 tempest-VolumesMetadataTest-1952619508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-851dfd56-2755-4e14-ab7b-d797f9ff1394 tempest-VolumesMetadataTest-1952619508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-851dfd56-2755-4e14-ab7b-d797f9ff1394 tempest-VolumesMetadataTest-1952619508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-851dfd56-2755-4e14-ab7b-d797f9ff1394 tempest-VolumesMetadataTest-1952619508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-851dfd56-2755-4e14-ab7b-d797f9ff1394 tempest-VolumesMetadataTest-1952619508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:00 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-bc0cd841-e259-4249-b903-488741f7a325 tempest-AttachVolumeNegativeTest-105042574 None] Deleted volume successfully. Sep 06 08:09:00 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:09:00 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bc0cd841-e259-4249-b903-488741f7a325 tempest-AttachVolumeNegativeTest-105042574 None] Lock "cinder-9eb0125f-4485-4503-8983-3985408e4cef-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:01 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e.afbbbca5-065a-470e-9a6f-04bf3e2d70bb" returned: 0 in 0.306s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-quobyte-afbbbca5-065a-470e-9a6f-04bf3e2d70bb" released by "_delete_snapshot" :: held 2.115s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-quobyte-54faeb35-08aa-42a9-8edd-0836be32432e" released by "delete_snapshot" :: held 2.149s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:01 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Created reservations ['987cf6bb-e841-43ac-a1b8-13bade26670d', '145bf6e8-1823-4100-99c2-a69a1ca9be48', '1afb2150-6e10-4125-92e0-7b3e6c20c742', 'f165e344-a698-4db5-96d1-460be0ff88e8'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:09:01 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:01 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Delete snapshot completed successfully. Sep 06 08:09:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-851dfd56-2755-4e14-ab7b-d797f9ff1394 tempest-VolumesMetadataTest-1952619508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.288s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:01 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-851dfd56-2755-4e14-ab7b-d797f9ff1394 tempest-VolumesMetadataTest-1952619508 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:09:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-afbbbca5-065a-470e-9a6f-04bf3e2d70bb-delete_snapshot" released by "delete_snapshot" :: held 2.352s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Snapshots deleted, issuing volume delete {{(pid=87307) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 06 08:09:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "cinder-quobyte-54faeb35-08aa-42a9-8edd-0836be32432e" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:01 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-851dfd56-2755-4e14-ab7b-d797f9ff1394 tempest-VolumesMetadataTest-1952619508 None] Deleted volume successfully. Sep 06 08:09:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-quobyte-54faeb35-08aa-42a9-8edd-0836be32432e" acquired by "delete_volume" :: waited 0.026s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-851dfd56-2755-4e14-ab7b-d797f9ff1394 tempest-VolumesMetadataTest-1952619508 None] Lock "cinder-f6f6041f-a425-45a6-ae71-bb5a326b06bb-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:01 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2271da4c-f054-4ffb-9149-67f5aa964a32]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:01 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e Sep 06 08:09:01 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2ac41f0b-df0b-438b-b240-7637c82a4bf9 tempest-AttachVolumeNegativeTest-105042574 None] Acquiring lock "cinder-6fb84fd1-6209-4b5a-b40a-f13e5b302772-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2ac41f0b-df0b-438b-b240-7637c82a4bf9 tempest-AttachVolumeNegativeTest-105042574 None] Lock "cinder-6fb84fd1-6209-4b5a-b40a-f13e5b302772-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2ac41f0b-df0b-438b-b240-7637c82a4bf9 tempest-AttachVolumeNegativeTest-105042574 None] Acquiring lock "cinder-quobyte-6fb84fd1-6209-4b5a-b40a-f13e5b302772" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2ac41f0b-df0b-438b-b240-7637c82a4bf9 tempest-AttachVolumeNegativeTest-105042574 None] Lock "cinder-quobyte-6fb84fd1-6209-4b5a-b40a-f13e5b302772" acquired by "delete_volume" :: waited 0.041s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:01 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd47bdc-8598-4219-b03f-2f07d09959dc]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2ac41f0b-df0b-438b-b240-7637c82a4bf9 tempest-AttachVolumeNegativeTest-105042574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6fb84fd1-6209-4b5a-b40a-f13e5b302772 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:01 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e" returned: 0 in 0.588s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:01 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6fb84fd1-6209-4b5a-b40a-f13e5b302772 Sep 06 08:09:01 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:01 devstack sudo[95457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e Sep 06 08:09:01 devstack sudo[95457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:01 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Flow 'volume_create_manager' (46c29565-29c1-454c-bf60-b6a0acf05209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22e7481a-972b-4cda-8723-260b20b10b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22e7481a-972b-4cda-8723-260b20b10b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1908939112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17bec870-2b75-4c65-be19-2c2e5e2c6dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ad687c962a41c88031bc3a7e8059b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:02Z,use_quota=True,user_id='18e4f4c989e6494da56ad015cdf4b3a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e1a4cf-d730-4921-9732-4e457249ef0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e1a4cf-d730-4921-9732-4e457249ef0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceebb59b-4030-451b-8a7c-670f6a1718ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceebb59b-4030-451b-8a7c-670f6a1718ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17bec870-2b75-4c65-be19-2c2e5e2c6dfa', 'volume_name': 'volume-17bec870-2b75-4c65-be19-2c2e5e2c6dfa', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (441c6bc5-b1d2-4fb6-a18e-06faf6eebe31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (441c6bc5-b1d2-4fb6-a18e-06faf6eebe31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697bbd28-dfd9-4d10-9426-af4859b15e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:02 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Volume 17bec870-2b75-4c65-be19-2c2e5e2c6dfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17bec870-2b75-4c65-be19-2c2e5e2c6dfa', 'volume_size': 1} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1908939112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17bec870-2b75-4c65-be19-2c2e5e2c6dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ad687c962a41c88031bc3a7e8059b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:02Z,use_quota=True,user_id='18e4f4c989e6494da56ad015cdf4b3a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Creating volume 17bec870-2b75-4c65-be19-2c2e5e2c6dfa {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:09:02 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-17bec870-2b75-4c65-be19-2c2e5e2c6dfa 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:02 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-17bec870-2b75-4c65-be19-2c2e5e2c6dfa 1073741824 Sep 06 08:09:02 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:02 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2ac41f0b-df0b-438b-b240-7637c82a4bf9 tempest-AttachVolumeNegativeTest-105042574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6fb84fd1-6209-4b5a-b40a-f13e5b302772" returned: 0 in 0.499s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2ac41f0b-df0b-438b-b240-7637c82a4bf9 tempest-AttachVolumeNegativeTest-105042574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6fb84fd1-6209-4b5a-b40a-f13e5b302772 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:02 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6fb84fd1-6209-4b5a-b40a-f13e5b302772 Sep 06 08:09:02 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:02 devstack sudo[95457]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-54faeb35-08aa-42a9-8edd-0836be32432e" returned: 0 in 0.455s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-quobyte-54faeb35-08aa-42a9-8edd-0836be32432e" released by "delete_volume" :: held 1.164s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Created reservations ['d7df0b47-e0b6-453d-801b-c0b979c61dc2', '0cd6edf5-28cd-4ba8-bc77-c2991c8c9684', '28a4f024-c17d-4d14-8f1a-58583b715d9d', 'a95ef644-2119-44f9-9143-bf702590740d'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:02 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:09:02 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:02 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2ac41f0b-df0b-438b-b240-7637c82a4bf9 tempest-AttachVolumeNegativeTest-105042574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6fb84fd1-6209-4b5a-b40a-f13e5b302772" returned: 0 in 0.481s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2ac41f0b-df0b-438b-b240-7637c82a4bf9 tempest-AttachVolumeNegativeTest-105042574 None] Lock "cinder-quobyte-6fb84fd1-6209-4b5a-b40a-f13e5b302772" released by "delete_volume" :: held 1.047s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-2ac41f0b-df0b-438b-b240-7637c82a4bf9 tempest-AttachVolumeNegativeTest-105042574 None] Created reservations ['7ed19f70-24d4-4b82-a498-cfb7bd6caca5', '2bbc46bb-2562-45c1-864e-41cb36456ead', '9437c3fd-22e8-40f1-9123-21cbdf412288', 'c33629ba-d233-4449-a38f-c34bd36de79e'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:09:02 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-17bec870-2b75-4c65-be19-2c2e5e2c6dfa 1073741824" returned: 0 in 0.843s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-17bec870-2b75-4c65-be19-2c2e5e2c6dfa {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:03 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.521s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:03 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:09:03 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-17bec870-2b75-4c65-be19-2c2e5e2c6dfa Sep 06 08:09:03 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:03 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Deleted volume successfully. Sep 06 08:09:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2ac41f0b-df0b-438b-b240-7637c82a4bf9 tempest-AttachVolumeNegativeTest-105042574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2ac41f0b-df0b-438b-b240-7637c82a4bf9 tempest-AttachVolumeNegativeTest-105042574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:03 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2ac41f0b-df0b-438b-b240-7637c82a4bf9 tempest-AttachVolumeNegativeTest-105042574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:03 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2ac41f0b-df0b-438b-b240-7637c82a4bf9 tempest-AttachVolumeNegativeTest-105042574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2ac41f0b-df0b-438b-b240-7637c82a4bf9 tempest-AttachVolumeNegativeTest-105042574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2ac41f0b-df0b-438b-b240-7637c82a4bf9 tempest-AttachVolumeNegativeTest-105042574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c4b5dd52-8ae7-4297-9cf3-2954d70624ca tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-54faeb35-08aa-42a9-8edd-0836be32432e-delete_volume" released by "delete_volume" :: held 10.768s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:03 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:09:03 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:03 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-17bec870-2b75-4c65-be19-2c2e5e2c6dfa" returned: 0 in 0.490s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:03 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:09:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:03 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697bbd28-dfd9-4d10-9426-af4859b15e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17bec870-2b75-4c65-be19-2c2e5e2c6dfa', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:03 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcb61297-a165-42a6-8796-b4a17c8461eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:03 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Volume volume-17bec870-2b75-4c65-be19-2c2e5e2c6dfa (17bec870-2b75-4c65-be19-2c2e5e2c6dfa): created successfully Sep 06 08:09:03 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcb61297-a165-42a6-8796-b4a17c8461eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:03 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Flow 'volume_create_manager' (46c29565-29c1-454c-bf60-b6a0acf05209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:03 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-c2090a83-6ed7-4df6-93b3-e14523dfd1e0 tempest-ServersNegativeTestJSON-1116285568 None] Created volume successfully. Sep 06 08:09:03 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2ac41f0b-df0b-438b-b240-7637c82a4bf9 tempest-AttachVolumeNegativeTest-105042574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.551s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:03 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-2ac41f0b-df0b-438b-b240-7637c82a4bf9 tempest-AttachVolumeNegativeTest-105042574 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:09:03 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-2ac41f0b-df0b-438b-b240-7637c82a4bf9 tempest-AttachVolumeNegativeTest-105042574 None] Deleted volume successfully. Sep 06 08:09:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2ac41f0b-df0b-438b-b240-7637c82a4bf9 tempest-AttachVolumeNegativeTest-105042574 None] Lock "cinder-6fb84fd1-6209-4b5a-b40a-f13e5b302772-delete_volume" released by "delete_volume" :: held 2.132s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:04 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:09:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Flow 'volume_create_manager' (bfd391c8-74df-49da-bcfa-15a99b113004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32306f00-4b7b-424c-b49d-fd4265c0180c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32306f00-4b7b-424c-b49d-fd4265c0180c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-852958791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44df6db3-317e-43fd-a482-94f33eb2114b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd1818bcdd34b46b05f51d821e5ea6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:04Z,use_quota=True,user_id='818b3355584f4e3db47ab49a115bc87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d6bb97-8550-4e4c-9b80-bc0f04735261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d6bb97-8550-4e4c-9b80-bc0f04735261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5b84e3-dd17-4483-a9c9-d299463f90b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5b84e3-dd17-4483-a9c9-d299463f90b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44df6db3-317e-43fd-a482-94f33eb2114b', 'volume_name': 'volume-44df6db3-317e-43fd-a482-94f33eb2114b', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d6b5b0-1452-442e-a3d7-0b85ee89d80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d6b5b0-1452-442e-a3d7-0b85ee89d80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f9f273-1c72-4d94-8b34-26bddd366dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:04 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Volume 44df6db3-317e-43fd-a482-94f33eb2114b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44df6db3-317e-43fd-a482-94f33eb2114b', 'volume_size': 1} Sep 06 08:09:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:04 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-852958791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44df6db3-317e-43fd-a482-94f33eb2114b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd1818bcdd34b46b05f51d821e5ea6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:04Z,use_quota=True,user_id='818b3355584f4e3db47ab49a115bc87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:09:04 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Creating volume 44df6db3-317e-43fd-a482-94f33eb2114b {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:09:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:04 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:04 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:04 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:09:04 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:09:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:04 devstack sudo[95486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b 1073741824 Sep 06 08:09:04 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:05 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b 1073741824" returned: 0 in 0.596s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:05 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b Sep 06 08:09:05 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:05 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b" returned: 0 in 0.394s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:05 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:09:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f9f273-1c72-4d94-8b34-26bddd366dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44df6db3-317e-43fd-a482-94f33eb2114b', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91d7b045-e03e-4373-b475-204aed5332b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:05 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Volume volume-44df6db3-317e-43fd-a482-94f33eb2114b (44df6db3-317e-43fd-a482-94f33eb2114b): created successfully Sep 06 08:09:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91d7b045-e03e-4373-b475-204aed5332b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Flow 'volume_create_manager' (bfd391c8-74df-49da-bcfa-15a99b113004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:05 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-d9853eaf-7bae-41ba-a16e-3d4d092f6a41 tempest-VolumesDeleteCascade-220040628 None] Created volume successfully. Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Flow 'volume_create_manager' (d0533987-1200-4eb4-bd43-8715032bfdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673b3bd2-1ae0-42c3-9010-f02bb1891855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673b3bd2-1ae0-42c3-9010-f02bb1891855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-417822554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ad687c962a41c88031bc3a7e8059b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:06Z,use_quota=True,user_id='18e4f4c989e6494da56ad015cdf4b3a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bbc3ca5-da78-4fee-b3ed-25850542e4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bbc3ca5-da78-4fee-b3ed-25850542e4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6c8034-d0df-4762-97f9-827a1ca89c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6c8034-d0df-4762-97f9-827a1ca89c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3', 'volume_name': 'volume-40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d51cfda7-eda4-4fd6-b3bf-b5be618f63da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d51cfda7-eda4-4fd6-b3bf-b5be618f63da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ceda34-d397-4a0c-853c-5e189a83608c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:06 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Volume 40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3', 'volume_size': 1} Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-417822554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ad687c962a41c88031bc3a7e8059b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:06Z,use_quota=True,user_id='18e4f4c989e6494da56ad015cdf4b3a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Creating volume 40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:09:06 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:06 devstack sudo[95496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3 1073741824 Sep 06 08:09:06 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2c1d03b0-1bd2-47e6-85db-5f92eca8905a tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:06 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3 1073741824" returned: 0 in 0.583s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:06 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3 Sep 06 08:09:06 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:07 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3" returned: 0 in 0.270s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:09:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2c1d03b0-1bd2-47e6-85db-5f92eca8905a tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.465s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ceda34-d397-4a0c-853c-5e189a83608c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5647b77d-3a4b-404c-adf9-b6e786afa96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-2c1d03b0-1bd2-47e6-85db-5f92eca8905a tempest-VolumesDeleteCascade-220040628 None] Creating offline snapshot 2bde1d3b-05b8-463d-b0c4-ba925a22a69c of volume 44df6db3-317e-43fd-a482-94f33eb2114b {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:09:07 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Volume volume-40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3 (40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3): created successfully Sep 06 08:09:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5647b77d-3a4b-404c-adf9-b6e786afa96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Flow 'volume_create_manager' (d0533987-1200-4eb4-bd43-8715032bfdf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:07 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5463cdd3-a7d5-4b98-afe6-ad3500772c0d]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2c1d03b0-1bd2-47e6-85db-5f92eca8905a tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:07 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-29809c19-bfcd-4099-8b4e-dcb81869a5be tempest-ServersNegativeTestJSON-1116285568 None] Created volume successfully. Sep 06 08:09:07 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b Sep 06 08:09:07 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:07 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2c1d03b0-1bd2-47e6-85db-5f92eca8905a tempest-VolumesDeleteCascade-220040628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b" returned: 0 in 0.449s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2c1d03b0-1bd2-47e6-85db-5f92eca8905a tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.2bde1d3b-05b8-463d-b0c4-ba925a22a69c 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:07 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.2bde1d3b-05b8-463d-b0c4-ba925a22a69c 1G Sep 06 08:09:07 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:08 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2c1d03b0-1bd2-47e6-85db-5f92eca8905a tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.2bde1d3b-05b8-463d-b0c4-ba925a22a69c 1G" returned: 0 in 0.447s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2c1d03b0-1bd2-47e6-85db-5f92eca8905a tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44df6db3-317e-43fd-a482-94f33eb2114b -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.2bde1d3b-05b8-463d-b0c4-ba925a22a69c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:08 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44df6db3-317e-43fd-a482-94f33eb2114b -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.2bde1d3b-05b8-463d-b0c4-ba925a22a69c Sep 06 08:09:08 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:08 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2c1d03b0-1bd2-47e6-85db-5f92eca8905a tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44df6db3-317e-43fd-a482-94f33eb2114b -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.2bde1d3b-05b8-463d-b0c4-ba925a22a69c" returned: 0 in 0.473s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:08 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-2c1d03b0-1bd2-47e6-85db-5f92eca8905a tempest-VolumesDeleteCascade-220040628 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.2bde1d3b-05b8-463d-b0c4-ba925a22a69c is being set with open permissions: ugo+rw Sep 06 08:09:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2c1d03b0-1bd2-47e6-85db-5f92eca8905a tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.2bde1d3b-05b8-463d-b0c4-ba925a22a69c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:08 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.2bde1d3b-05b8-463d-b0c4-ba925a22a69c Sep 06 08:09:08 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:08 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:09:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Flow 'volume_create_manager' (60658c29-78aa-4f55-a3ad-2a6723fa61c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f9ec68d-f4ef-4ef4-bece-33a55845480c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:08 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b0a4fee1-2f31-44e4-a9ef-af0022110912 tempest-ServersNegativeTestJSON-1116285568 None] Acquiring lock "cinder-40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f9ec68d-f4ef-4ef4-bece-33a55845480c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1489053438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a653298-66bc-4849-9d01-1d675a915abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6d6850c8c348c99e90b196466a03b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:09Z,use_quota=True,user_id='1fd3e18f5f1e4523b30db8348cfe6562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (524c3d97-c483-42d5-aee4-2d1d5ac0900a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (524c3d97-c483-42d5-aee4-2d1d5ac0900a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2d2b10a-99d1-43ea-a199-31593283de48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:08 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2d2b10a-99d1-43ea-a199-31593283de48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a653298-66bc-4849-9d01-1d675a915abe', 'volume_name': 'volume-9a653298-66bc-4849-9d01-1d675a915abe', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd06db7b-4557-4a06-89dc-28eed0c43c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd06db7b-4557-4a06-89dc-28eed0c43c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab992950-a7c9-489d-85cf-257090e020f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:08 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Volume 9a653298-66bc-4849-9d01-1d675a915abe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a653298-66bc-4849-9d01-1d675a915abe', 'volume_size': 1} Sep 06 08:09:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2c1d03b0-1bd2-47e6-85db-5f92eca8905a tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.2bde1d3b-05b8-463d-b0c4-ba925a22a69c" returned: 0 in 0.343s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:08 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b0a4fee1-2f31-44e4-a9ef-af0022110912 tempest-ServersNegativeTestJSON-1116285568 None] Lock "cinder-40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2c1d03b0-1bd2-47e6-85db-5f92eca8905a tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:09 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b0a4fee1-2f31-44e4-a9ef-af0022110912 tempest-ServersNegativeTestJSON-1116285568 None] Acquiring lock "cinder-quobyte-40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:09 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.info Sep 06 08:09:09 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:09 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b0a4fee1-2f31-44e4-a9ef-af0022110912 tempest-ServersNegativeTestJSON-1116285568 None] Lock "cinder-quobyte-40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3" acquired by "delete_volume" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:09 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c064feff-5356-4bfd-a95b-30bb6ccce972]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b0a4fee1-2f31-44e4-a9ef-af0022110912 tempest-ServersNegativeTestJSON-1116285568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:09 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3 Sep 06 08:09:09 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:09 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2c1d03b0-1bd2-47e6-85db-5f92eca8905a tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.info" returned: 0 in 0.308s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:09 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-2c1d03b0-1bd2-47e6-85db-5f92eca8905a tempest-VolumesDeleteCascade-220040628 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.info is being set with open permissions: ugo+rw Sep 06 08:09:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2c1d03b0-1bd2-47e6-85db-5f92eca8905a tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:09 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.info Sep 06 08:09:09 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:09 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b0a4fee1-2f31-44e4-a9ef-af0022110912 tempest-ServersNegativeTestJSON-1116285568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3" returned: 0 in 0.514s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b0a4fee1-2f31-44e4-a9ef-af0022110912 tempest-ServersNegativeTestJSON-1116285568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:09 devstack sudo[95540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3 Sep 06 08:09:09 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:09 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2c1d03b0-1bd2-47e6-85db-5f92eca8905a tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.info" returned: 0 in 0.333s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2c1d03b0-1bd2-47e6-85db-5f92eca8905a tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.508s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.725s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:09 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1489053438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a653298-66bc-4849-9d01-1d675a915abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6d6850c8c348c99e90b196466a03b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:09Z,use_quota=True,user_id='1fd3e18f5f1e4523b30db8348cfe6562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:09:09 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Creating volume 9a653298-66bc-4849-9d01-1d675a915abe {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:09:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:09 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:09 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:09 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:09:09 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:09:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a653298-66bc-4849-9d01-1d675a915abe 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:09 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a653298-66bc-4849-9d01-1d675a915abe 1073741824 Sep 06 08:09:09 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:09 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-2c1d03b0-1bd2-47e6-85db-5f92eca8905a tempest-VolumesDeleteCascade-220040628 None] Create snapshot completed successfully Sep 06 08:09:09 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b0a4fee1-2f31-44e4-a9ef-af0022110912 tempest-ServersNegativeTestJSON-1116285568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3" returned: 0 in 0.292s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:09 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b0a4fee1-2f31-44e4-a9ef-af0022110912 tempest-ServersNegativeTestJSON-1116285568 None] Lock "cinder-quobyte-40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3" released by "delete_volume" :: held 0.858s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:09 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-b0a4fee1-2f31-44e4-a9ef-af0022110912 tempest-ServersNegativeTestJSON-1116285568 None] Created reservations ['d74baf6f-467e-435b-8b4f-b1cbca2ed5f7', '37acfe48-892d-4aed-bebc-9fa79fc2b5b5', 'dcab5515-439f-4847-bf51-aad96028e507', '11e858cd-6f6e-4003-946b-d9b29574f662'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b0a4fee1-2f31-44e4-a9ef-af0022110912 tempest-ServersNegativeTestJSON-1116285568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b0a4fee1-2f31-44e4-a9ef-af0022110912 tempest-ServersNegativeTestJSON-1116285568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b0a4fee1-2f31-44e4-a9ef-af0022110912 tempest-ServersNegativeTestJSON-1116285568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b0a4fee1-2f31-44e4-a9ef-af0022110912 tempest-ServersNegativeTestJSON-1116285568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b0a4fee1-2f31-44e4-a9ef-af0022110912 tempest-ServersNegativeTestJSON-1116285568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b0a4fee1-2f31-44e4-a9ef-af0022110912 tempest-ServersNegativeTestJSON-1116285568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:10 devstack sudo[95548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:09:10 devstack sudo[95548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4aec1437-3479-4853-b705-37a8dd972e86 tempest-ServersNegativeTestJSON-1116285568 None] Acquiring lock "cinder-17bec870-2b75-4c65-be19-2c2e5e2c6dfa-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4aec1437-3479-4853-b705-37a8dd972e86 tempest-ServersNegativeTestJSON-1116285568 None] Lock "cinder-17bec870-2b75-4c65-be19-2c2e5e2c6dfa-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4aec1437-3479-4853-b705-37a8dd972e86 tempest-ServersNegativeTestJSON-1116285568 None] Acquiring lock "cinder-quobyte-17bec870-2b75-4c65-be19-2c2e5e2c6dfa" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4aec1437-3479-4853-b705-37a8dd972e86 tempest-ServersNegativeTestJSON-1116285568 None] Lock "cinder-quobyte-17bec870-2b75-4c65-be19-2c2e5e2c6dfa" acquired by "delete_volume" :: waited 0.019s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1673fd-397a-426b-9ebf-eb6ea487cb87]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4aec1437-3479-4853-b705-37a8dd972e86 tempest-ServersNegativeTestJSON-1116285568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-17bec870-2b75-4c65-be19-2c2e5e2c6dfa {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:10 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a653298-66bc-4849-9d01-1d675a915abe 1073741824" returned: 0 in 0.616s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a653298-66bc-4849-9d01-1d675a915abe {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:10 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-17bec870-2b75-4c65-be19-2c2e5e2c6dfa Sep 06 08:09:10 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:10 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a653298-66bc-4849-9d01-1d675a915abe Sep 06 08:09:10 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:10 devstack sudo[95548]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b0a4fee1-2f31-44e4-a9ef-af0022110912 tempest-ServersNegativeTestJSON-1116285568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.337s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-b0a4fee1-2f31-44e4-a9ef-af0022110912 tempest-ServersNegativeTestJSON-1116285568 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:09:10 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-b0a4fee1-2f31-44e4-a9ef-af0022110912 tempest-ServersNegativeTestJSON-1116285568 None] Deleted volume successfully. Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b0a4fee1-2f31-44e4-a9ef-af0022110912 tempest-ServersNegativeTestJSON-1116285568 None] Lock "cinder-40b4fbf2-eab7-4fa3-8cf6-71b4b8f4bfa3-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:10 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a653298-66bc-4849-9d01-1d675a915abe" returned: 0 in 0.314s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:10 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4aec1437-3479-4853-b705-37a8dd972e86 tempest-ServersNegativeTestJSON-1116285568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-17bec870-2b75-4c65-be19-2c2e5e2c6dfa" returned: 0 in 0.446s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4aec1437-3479-4853-b705-37a8dd972e86 tempest-ServersNegativeTestJSON-1116285568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-17bec870-2b75-4c65-be19-2c2e5e2c6dfa {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab992950-a7c9-489d-85cf-257090e020f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a653298-66bc-4849-9d01-1d675a915abe', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:10 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-17bec870-2b75-4c65-be19-2c2e5e2c6dfa Sep 06 08:09:10 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eabbcdb-7e7d-47c0-989f-eefc9541b21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:10 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Volume volume-9a653298-66bc-4849-9d01-1d675a915abe (9a653298-66bc-4849-9d01-1d675a915abe): created successfully Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eabbcdb-7e7d-47c0-989f-eefc9541b21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Flow 'volume_create_manager' (60658c29-78aa-4f55-a3ad-2a6723fa61c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:10 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f6e45c64-8704-4f0c-8975-f5441014700c tempest-VolumesTransfersV357Test-795565154 None] Created volume successfully. Sep 06 08:09:11 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4aec1437-3479-4853-b705-37a8dd972e86 tempest-ServersNegativeTestJSON-1116285568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-17bec870-2b75-4c65-be19-2c2e5e2c6dfa" returned: 0 in 0.347s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4aec1437-3479-4853-b705-37a8dd972e86 tempest-ServersNegativeTestJSON-1116285568 None] Lock "cinder-quobyte-17bec870-2b75-4c65-be19-2c2e5e2c6dfa" released by "delete_volume" :: held 0.848s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-4aec1437-3479-4853-b705-37a8dd972e86 tempest-ServersNegativeTestJSON-1116285568 None] Created reservations ['05f309e7-d97b-4705-a329-be297f83591f', 'c689c5b0-b9af-4cf9-934b-7f8e05ad273f', '199c5683-3f00-43f8-bc0c-91822084c334', '845925c1-77f1-4df2-8188-9c75a164ca81'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-4aec1437-3479-4853-b705-37a8dd972e86 tempest-ServersNegativeTestJSON-1116285568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-4aec1437-3479-4853-b705-37a8dd972e86 tempest-ServersNegativeTestJSON-1116285568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-4aec1437-3479-4853-b705-37a8dd972e86 tempest-ServersNegativeTestJSON-1116285568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-4aec1437-3479-4853-b705-37a8dd972e86 tempest-ServersNegativeTestJSON-1116285568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-4aec1437-3479-4853-b705-37a8dd972e86 tempest-ServersNegativeTestJSON-1116285568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4aec1437-3479-4853-b705-37a8dd972e86 tempest-ServersNegativeTestJSON-1116285568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:11 devstack sudo[95562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:09:11 devstack sudo[95562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:11 devstack sudo[95562]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4aec1437-3479-4853-b705-37a8dd972e86 tempest-ServersNegativeTestJSON-1116285568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.339s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-4aec1437-3479-4853-b705-37a8dd972e86 tempest-ServersNegativeTestJSON-1116285568 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:09:11 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-4aec1437-3479-4853-b705-37a8dd972e86 tempest-ServersNegativeTestJSON-1116285568 None] Deleted volume successfully. Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4aec1437-3479-4853-b705-37a8dd972e86 tempest-ServersNegativeTestJSON-1116285568 None] Lock "cinder-17bec870-2b75-4c65-be19-2c2e5e2c6dfa-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Flow 'volume_create_manager' (3ceb941d-06f9-476c-a926-0e8eebfd4f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (465e6463-920f-4b7d-88ee-30a8ade454e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (465e6463-920f-4b7d-88ee-30a8ade454e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-836081953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd288e7d-4293-47c5-a3c9-049ff6818e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd1818bcdd34b46b05f51d821e5ea6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2bde1d3b-05b8-463d-b0c4-ba925a22a69c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:12Z,use_quota=True,user_id='818b3355584f4e3db47ab49a115bc87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc5158ec-0953-478b-9b56-334b40b6b476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc5158ec-0953-478b-9b56-334b40b6b476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c642f96d-3f25-4229-9949-dda0de4ea0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c642f96d-3f25-4229-9949-dda0de4ea0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dd288e7d-4293-47c5-a3c9-049ff6818e51', 'volume_name': 'volume-dd288e7d-4293-47c5-a3c9-049ff6818e51', 'volume_size': 1, 'snapshot_id': '2bde1d3b-05b8-463d-b0c4-ba925a22a69c'}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4655b9-6a4a-4681-9cdf-cc1be2946379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4655b9-6a4a-4681-9cdf-cc1be2946379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09813aa4-d117-475a-a443-5edb7e3fbeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:11 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Volume dd288e7d-4293-47c5-a3c9-049ff6818e51: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dd288e7d-4293-47c5-a3c9-049ff6818e51', 'volume_size': 1, 'snapshot_id': '2bde1d3b-05b8-463d-b0c4-ba925a22a69c'} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "cinder-quobyte-2bde1d3b-05b8-463d-b0c4-ba925a22a69c-dd288e7d-4293-47c5-a3c9-049ff6818e51" by "_create_volume_from_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-quobyte-2bde1d3b-05b8-463d-b0c4-ba925a22a69c-dd288e7d-4293-47c5-a3c9-049ff6818e51" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Creating volume dd288e7d-4293-47c5-a3c9-049ff6818e51 from snapshot 2bde1d3b-05b8-463d-b0c4-ba925a22a69c {{(pid=87307) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "cinder-quobyte-dd288e7d-4293-47c5-a3c9-049ff6818e51" by "_copy_volume_from_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-quobyte-dd288e7d-4293-47c5-a3c9-049ff6818e51" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] snapshot: 2bde1d3b-05b8-463d-b0c4-ba925a22a69c, volume: dd288e7d-4293-47c5-a3c9-049ff6818e51, {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:12 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:12 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb712df-075f-4cd0-8c87-08c910aafbaa]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.2bde1d3b-05b8-463d-b0c4-ba925a22a69c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:12 devstack sudo[95567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.2bde1d3b-05b8-463d-b0c4-ba925a22a69c Sep 06 08:09:12 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:12 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-435516eb-30d6-4d77-bbbd-fb72e4f0e158 tempest-VolumesTransfersV357Test-1147611442 None] Transfer volume completed successfully. Sep 06 08:09:12 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.2bde1d3b-05b8-463d-b0c4-ba925a22a69c" returned: 0 in 0.688s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:12 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44df6db3-317e-43fd-a482-94f33eb2114b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:09:12 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b1a4a8-7443-4a9c-bfab-57138bd8c3bb]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:12 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b Sep 06 08:09:12 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:13 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b" returned: 0 in 0.425s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] will copy from snapshot at /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 06 08:09:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Creating direct copy from snapshot {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 06 08:09:13 devstack cinder-volume[87307]: DEBUG cinder.utils [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Path /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd288e7d-4293-47c5-a3c9-049ff6818e51 not found in is_blk_device check {{(pid=87307) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 06 08:09:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd288e7d-4293-47c5-a3c9-049ff6818e51 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:13 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd288e7d-4293-47c5-a3c9-049ff6818e51 Sep 06 08:09:13 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-cd70e0fd-732c-4628-9982-3c757f57e24b tempest-VolumesTransfersV357Test-1894581435 None] Acquiring lock "cinder-9a653298-66bc-4849-9d01-1d675a915abe-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-cd70e0fd-732c-4628-9982-3c757f57e24b tempest-VolumesTransfersV357Test-1894581435 None] Lock "cinder-9a653298-66bc-4849-9d01-1d675a915abe-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-cd70e0fd-732c-4628-9982-3c757f57e24b tempest-VolumesTransfersV357Test-1894581435 None] Acquiring lock "cinder-quobyte-9a653298-66bc-4849-9d01-1d675a915abe" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-cd70e0fd-732c-4628-9982-3c757f57e24b tempest-VolumesTransfersV357Test-1894581435 None] Lock "cinder-quobyte-9a653298-66bc-4849-9d01-1d675a915abe" acquired by "delete_volume" :: waited 0.027s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:13 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fbf12e-1f4a-4f73-9ba5-fc90da23e23d]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cd70e0fd-732c-4628-9982-3c757f57e24b tempest-VolumesTransfersV357Test-1894581435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a653298-66bc-4849-9d01-1d675a915abe {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:13 devstack sudo[95602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a653298-66bc-4849-9d01-1d675a915abe Sep 06 08:09:13 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:14 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cd70e0fd-732c-4628-9982-3c757f57e24b tempest-VolumesTransfersV357Test-1894581435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a653298-66bc-4849-9d01-1d675a915abe" returned: 0 in 0.661s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cd70e0fd-732c-4628-9982-3c757f57e24b tempest-VolumesTransfersV357Test-1894581435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a653298-66bc-4849-9d01-1d675a915abe {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:14 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a653298-66bc-4849-9d01-1d675a915abe Sep 06 08:09:14 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:15 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cd70e0fd-732c-4628-9982-3c757f57e24b tempest-VolumesTransfersV357Test-1894581435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a653298-66bc-4849-9d01-1d675a915abe" returned: 0 in 0.932s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:15 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-cd70e0fd-732c-4628-9982-3c757f57e24b tempest-VolumesTransfersV357Test-1894581435 None] Lock "cinder-quobyte-9a653298-66bc-4849-9d01-1d675a915abe" released by "delete_volume" :: held 1.685s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:15 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-cd70e0fd-732c-4628-9982-3c757f57e24b tempest-VolumesTransfersV357Test-1894581435 None] Created reservations ['4da45650-b1c3-4340-85fe-cbfdb8c977bb', '6a6772b3-5b65-4470-99f0-24a652369068', 'a2d66d33-cc15-42bb-8dcb-2a64a91fb00c', '24579e2f-e944-4aee-8f04-efa37b3caf43'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:09:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ee4e339b-1133-4499-9b79-209cce6658b0 tempest-BackendsCapabilitiesAdminTestsJSON-1209248506 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.665195465088, 'free_capacity_gb': 1773.665195465088, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87307) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 06 08:09:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cd70e0fd-732c-4628-9982-3c757f57e24b tempest-VolumesTransfersV357Test-1894581435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cd70e0fd-732c-4628-9982-3c757f57e24b tempest-VolumesTransfersV357Test-1894581435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:15 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cd70e0fd-732c-4628-9982-3c757f57e24b tempest-VolumesTransfersV357Test-1894581435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:15 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cd70e0fd-732c-4628-9982-3c757f57e24b tempest-VolumesTransfersV357Test-1894581435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cd70e0fd-732c-4628-9982-3c757f57e24b tempest-VolumesTransfersV357Test-1894581435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cd70e0fd-732c-4628-9982-3c757f57e24b tempest-VolumesTransfersV357Test-1894581435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-da327ddd-802e-41a6-8c44-1159ad2653c2 tempest-BackendsCapabilitiesAdminTestsJSON-1209248506 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.665195465088, 'free_capacity_gb': 1773.665195465088, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87307) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 06 08:09:15 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:09:15 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:16 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cd70e0fd-732c-4628-9982-3c757f57e24b tempest-VolumesTransfersV357Test-1894581435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.900s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:16 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-cd70e0fd-732c-4628-9982-3c757f57e24b tempest-VolumesTransfersV357Test-1894581435 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:09:16 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-cd70e0fd-732c-4628-9982-3c757f57e24b tempest-VolumesTransfersV357Test-1894581435 None] Deleted volume successfully. Sep 06 08:09:16 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-cd70e0fd-732c-4628-9982-3c757f57e24b tempest-VolumesTransfersV357Test-1894581435 None] Lock "cinder-9a653298-66bc-4849-9d01-1d675a915abe-delete_volume" released by "delete_volume" :: held 3.142s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:17 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:09:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Flow 'volume_create_manager' (4dfb1e4d-dd94-4ec1-8063-6f9908f76401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600c59b9-b185-489b-ba52-e9036ec8435f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600c59b9-b185-489b-ba52-e9036ec8435f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-670165399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf69d30e-ff8f-4e81-b13c-a65d5c939dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6d6850c8c348c99e90b196466a03b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:17Z,use_quota=True,user_id='1fd3e18f5f1e4523b30db8348cfe6562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d1c65ef-092a-4f6b-857e-a5ecf889fbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d1c65ef-092a-4f6b-857e-a5ecf889fbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f63205c-d99c-4f74-ad6d-d2bfda34e20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f63205c-d99c-4f74-ad6d-d2bfda34e20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf69d30e-ff8f-4e81-b13c-a65d5c939dd7', 'volume_name': 'volume-bf69d30e-ff8f-4e81-b13c-a65d5c939dd7', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e782ec8-f2d3-4893-98e1-3929ae7e3cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e782ec8-f2d3-4893-98e1-3929ae7e3cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95bebfc2-ade4-43c9-8a6c-4c16137b7183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:17 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Volume bf69d30e-ff8f-4e81-b13c-a65d5c939dd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf69d30e-ff8f-4e81-b13c-a65d5c939dd7', 'volume_size': 1} Sep 06 08:09:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:19 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd288e7d-4293-47c5-a3c9-049ff6818e51" returned: 0 in 6.577s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:19 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Image conversion details: src /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b, size 1024.00 MB, duration 6.58 sec, destination /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd288e7d-4293-47c5-a3c9-049ff6818e51 {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:09:19 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Converted 1024.00 MB image at 155.67 MB/s Sep 06 08:09:19 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd288e7d-4293-47c5-a3c9-049ff6818e51 is being set with open permissions: ugo+rw Sep 06 08:09:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd288e7d-4293-47c5-a3c9-049ff6818e51 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:19 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd288e7d-4293-47c5-a3c9-049ff6818e51 Sep 06 08:09:19 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:20 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd288e7d-4293-47c5-a3c9-049ff6818e51" returned: 0 in 0.285s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-quobyte-dd288e7d-4293-47c5-a3c9-049ff6818e51" released by "_copy_volume_from_snapshot" :: held 8.103s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-quobyte-2bde1d3b-05b8-463d-b0c4-ba925a22a69c-dd288e7d-4293-47c5-a3c9-049ff6818e51" released by "_create_volume_from_snapshot" :: held 8.232s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.280s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.234s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-670165399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf69d30e-ff8f-4e81-b13c-a65d5c939dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6d6850c8c348c99e90b196466a03b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:17Z,use_quota=True,user_id='1fd3e18f5f1e4523b30db8348cfe6562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Creating volume bf69d30e-ff8f-4e81-b13c-a65d5c939dd7 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:09:20 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf69d30e-ff8f-4e81-b13c-a65d5c939dd7 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09813aa4-d117-475a-a443-5edb7e3fbeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd288e7d-4293-47c5-a3c9-049ff6818e51', 'volume_size': 1, 'snapshot_id': '2bde1d3b-05b8-463d-b0c4-ba925a22a69c'}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4297e590-ce15-4a5c-9e47-9cd897285eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:20 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf69d30e-ff8f-4e81-b13c-a65d5c939dd7 1073741824 Sep 06 08:09:20 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:20 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Volume volume-dd288e7d-4293-47c5-a3c9-049ff6818e51 (dd288e7d-4293-47c5-a3c9-049ff6818e51): created successfully Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4297e590-ce15-4a5c-9e47-9cd897285eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Flow 'volume_create_manager' (3ceb941d-06f9-476c-a926-0e8eebfd4f0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:20 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e749f979-dd55-439d-bdbb-020a3f4732c0 tempest-VolumesDeleteCascade-220040628 None] Created volume successfully. Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "cinder-44df6db3-317e-43fd-a482-94f33eb2114b-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:20 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf69d30e-ff8f-4e81-b13c-a65d5c939dd7 1073741824" returned: 0 in 0.603s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-44df6db3-317e-43fd-a482-94f33eb2114b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Performing cascade delete. {{(pid=87307) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf69d30e-ff8f-4e81-b13c-a65d5c939dd7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "cinder-2bde1d3b-05b8-463d-b0c4-ba925a22a69c-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:20 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf69d30e-ff8f-4e81-b13c-a65d5c939dd7 Sep 06 08:09:20 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-2bde1d3b-05b8-463d-b0c4-ba925a22a69c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "cinder-quobyte-44df6db3-317e-43fd-a482-94f33eb2114b" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-quobyte-44df6db3-317e-43fd-a482-94f33eb2114b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "cinder-quobyte-2bde1d3b-05b8-463d-b0c4-ba925a22a69c" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-quobyte-2bde1d3b-05b8-463d-b0c4-ba925a22a69c" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Deleting offline snapshot 2bde1d3b-05b8-463d-b0c4-ba925a22a69c of volume 44df6db3-317e-43fd-a482-94f33eb2114b {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] snapshot_file for this snap is: volume-44df6db3-317e-43fd-a482-94f33eb2114b.2bde1d3b-05b8-463d-b0c4-ba925a22a69c {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d42625-ed38-435b-8dfe-ae5fa773bdb1]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.2bde1d3b-05b8-463d-b0c4-ba925a22a69c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:21 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf69d30e-ff8f-4e81-b13c-a65d5c939dd7" returned: 0 in 0.328s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:09:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:21 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.2bde1d3b-05b8-463d-b0c4-ba925a22a69c Sep 06 08:09:21 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95bebfc2-ade4-43c9-8a6c-4c16137b7183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf69d30e-ff8f-4e81-b13c-a65d5c939dd7', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab1e3f4-034b-4bb9-b58c-fe6ba2d6089e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:21 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Volume volume-bf69d30e-ff8f-4e81-b13c-a65d5c939dd7 (bf69d30e-ff8f-4e81-b13c-a65d5c939dd7): created successfully Sep 06 08:09:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab1e3f4-034b-4bb9-b58c-fe6ba2d6089e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Flow 'volume_create_manager' (4dfb1e4d-dd94-4ec1-8063-6f9908f76401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:21 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-7e452b42-1b20-4b59-bfd0-a84ec8d50ac8 tempest-VolumesTransfersV357Test-795565154 None] Created volume successfully. Sep 06 08:09:21 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.2bde1d3b-05b8-463d-b0c4-ba925a22a69c" returned: 0 in 0.477s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44df6db3-317e-43fd-a482-94f33eb2114b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:09:21 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36cbd93-804c-4e7a-8b55-932e6c277a26]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:21 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b Sep 06 08:09:21 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:22 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-334272cf-b3a3-477c-9049-1a6eb46bf577 tempest-VolumesTransfersV357Test-1894581435 None] Acquiring lock "cinder-bf69d30e-ff8f-4e81-b13c-a65d5c939dd7-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:22 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-334272cf-b3a3-477c-9049-1a6eb46bf577 tempest-VolumesTransfersV357Test-1894581435 None] Lock "cinder-bf69d30e-ff8f-4e81-b13c-a65d5c939dd7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:22 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b" returned: 0 in 0.618s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.2bde1d3b-05b8-463d-b0c4-ba925a22a69c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:22 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.2bde1d3b-05b8-463d-b0c4-ba925a22a69c Sep 06 08:09:22 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:22 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-334272cf-b3a3-477c-9049-1a6eb46bf577 tempest-VolumesTransfersV357Test-1894581435 None] Acquiring lock "cinder-quobyte-bf69d30e-ff8f-4e81-b13c-a65d5c939dd7" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:22 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-334272cf-b3a3-477c-9049-1a6eb46bf577 tempest-VolumesTransfersV357Test-1894581435 None] Lock "cinder-quobyte-bf69d30e-ff8f-4e81-b13c-a65d5c939dd7" acquired by "delete_volume" :: waited 0.021s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:22 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5aa7646-871d-486c-8615-d3dbf677d6d8]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-334272cf-b3a3-477c-9049-1a6eb46bf577 tempest-VolumesTransfersV357Test-1894581435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf69d30e-ff8f-4e81-b13c-a65d5c939dd7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:22 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf69d30e-ff8f-4e81-b13c-a65d5c939dd7 Sep 06 08:09:22 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:22 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.2bde1d3b-05b8-463d-b0c4-ba925a22a69c" returned: 0 in 0.409s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.2bde1d3b-05b8-463d-b0c4-ba925a22a69c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:22 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.2bde1d3b-05b8-463d-b0c4-ba925a22a69c Sep 06 08:09:22 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:22 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-334272cf-b3a3-477c-9049-1a6eb46bf577 tempest-VolumesTransfersV357Test-1894581435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf69d30e-ff8f-4e81-b13c-a65d5c939dd7" returned: 0 in 0.402s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-334272cf-b3a3-477c-9049-1a6eb46bf577 tempest-VolumesTransfersV357Test-1894581435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf69d30e-ff8f-4e81-b13c-a65d5c939dd7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:22 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf69d30e-ff8f-4e81-b13c-a65d5c939dd7 Sep 06 08:09:22 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:22 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b.2bde1d3b-05b8-463d-b0c4-ba925a22a69c" returned: 0 in 0.325s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:22 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-quobyte-2bde1d3b-05b8-463d-b0c4-ba925a22a69c" released by "_delete_snapshot" :: held 1.970s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:22 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-quobyte-44df6db3-317e-43fd-a482-94f33eb2114b" released by "delete_snapshot" :: held 2.011s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:22 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Created reservations ['2914c2d9-fe0f-4909-ac8e-d7fc9d12682c', '30156e86-c1c7-45d1-a520-ae147cb4ef6f', '6f997e4d-fd83-4dad-87a8-bbfdff9e58ea', '5e07851c-0106-45f4-ab19-7f97d352b7d9'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:09:23 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Delete snapshot completed successfully. Sep 06 08:09:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-2bde1d3b-05b8-463d-b0c4-ba925a22a69c-delete_snapshot" released by "delete_snapshot" :: held 2.187s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Snapshots deleted, issuing volume delete {{(pid=87307) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 06 08:09:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "cinder-quobyte-44df6db3-317e-43fd-a482-94f33eb2114b" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:23 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-334272cf-b3a3-477c-9049-1a6eb46bf577 tempest-VolumesTransfersV357Test-1894581435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf69d30e-ff8f-4e81-b13c-a65d5c939dd7" returned: 0 in 0.411s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-quobyte-44df6db3-317e-43fd-a482-94f33eb2114b" acquired by "delete_volume" :: waited 0.024s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-334272cf-b3a3-477c-9049-1a6eb46bf577 tempest-VolumesTransfersV357Test-1894581435 None] Lock "cinder-quobyte-bf69d30e-ff8f-4e81-b13c-a65d5c939dd7" released by "delete_volume" :: held 0.922s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:23 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc986047-367c-4dd7-8535-ecc0acc85f87]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:23 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-334272cf-b3a3-477c-9049-1a6eb46bf577 tempest-VolumesTransfersV357Test-1894581435 None] Created reservations ['140d86e0-0560-49c6-832b-fc2e04c67eb0', '7674c071-e695-4c22-b4fe-ba00daff5d75', 'b1db3211-9690-4a6c-98af-a0e4b883e438', 'f83cd645-691a-4480-b0fa-5fb7066b08a8'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:09:23 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b Sep 06 08:09:23 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-334272cf-b3a3-477c-9049-1a6eb46bf577 tempest-VolumesTransfersV357Test-1894581435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-334272cf-b3a3-477c-9049-1a6eb46bf577 tempest-VolumesTransfersV357Test-1894581435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-334272cf-b3a3-477c-9049-1a6eb46bf577 tempest-VolumesTransfersV357Test-1894581435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-334272cf-b3a3-477c-9049-1a6eb46bf577 tempest-VolumesTransfersV357Test-1894581435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-334272cf-b3a3-477c-9049-1a6eb46bf577 tempest-VolumesTransfersV357Test-1894581435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-334272cf-b3a3-477c-9049-1a6eb46bf577 tempest-VolumesTransfersV357Test-1894581435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:23 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:09:23 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:23 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-334272cf-b3a3-477c-9049-1a6eb46bf577 tempest-VolumesTransfersV357Test-1894581435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.286s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:23 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-334272cf-b3a3-477c-9049-1a6eb46bf577 tempest-VolumesTransfersV357Test-1894581435 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:09:23 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b" returned: 0 in 0.556s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:23 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-334272cf-b3a3-477c-9049-1a6eb46bf577 tempest-VolumesTransfersV357Test-1894581435 None] Deleted volume successfully. Sep 06 08:09:23 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b Sep 06 08:09:23 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-334272cf-b3a3-477c-9049-1a6eb46bf577 tempest-VolumesTransfersV357Test-1894581435 None] Lock "cinder-bf69d30e-ff8f-4e81-b13c-a65d5c939dd7-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:23 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-44df6db3-317e-43fd-a482-94f33eb2114b" returned: 0 in 0.269s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-quobyte-44df6db3-317e-43fd-a482-94f33eb2114b" released by "delete_volume" :: held 0.915s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:24 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Created reservations ['5b2a9c40-0a89-422f-a821-ea979d725562', '0ad52dae-d853-4605-97d3-a066bc973fb6', '93ab9fd3-a073-4921-8aa0-09c3069bb290', 'b3f1a64e-5ede-4437-87aa-3e8ddfa415c2'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:09:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:24 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:09:24 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:24 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.302s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:24 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:09:24 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Deleted volume successfully. Sep 06 08:09:24 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f9eb73cc-002c-4fea-9f67-553f40ba7c45 tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-44df6db3-317e-43fd-a482-94f33eb2114b-delete_volume" released by "delete_volume" :: held 3.736s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:25 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-038313d7-1261-4306-8406-926173431271 tempest-GroupsTest-417670066 None] Group tempest-Group1-1811734265: creating Sep 06 08:09:25 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-038313d7-1261-4306-8406-926173431271 tempest-GroupsTest-417670066 None] Group tempest-Group1-1811734265: created successfully Sep 06 08:09:25 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-038313d7-1261-4306-8406-926173431271 tempest-GroupsTest-417670066 None] Create group completed successfully. Sep 06 08:09:25 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7c5d2da5-a105-406b-9f9d-3d397595c950 tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "cinder-dd288e7d-4293-47c5-a3c9-049ff6818e51-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:25 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7c5d2da5-a105-406b-9f9d-3d397595c950 tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-dd288e7d-4293-47c5-a3c9-049ff6818e51-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:25 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7c5d2da5-a105-406b-9f9d-3d397595c950 tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "cinder-quobyte-dd288e7d-4293-47c5-a3c9-049ff6818e51" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:25 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7c5d2da5-a105-406b-9f9d-3d397595c950 tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-quobyte-dd288e7d-4293-47c5-a3c9-049ff6818e51" acquired by "delete_volume" :: waited 0.016s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:25 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecee853-e743-4cc6-aad1-6c08daacd4c8]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7c5d2da5-a105-406b-9f9d-3d397595c950 tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd288e7d-4293-47c5-a3c9-049ff6818e51 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:25 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd288e7d-4293-47c5-a3c9-049ff6818e51 Sep 06 08:09:25 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:25 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7c5d2da5-a105-406b-9f9d-3d397595c950 tempest-VolumesDeleteCascade-220040628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd288e7d-4293-47c5-a3c9-049ff6818e51" returned: 0 in 0.405s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7c5d2da5-a105-406b-9f9d-3d397595c950 tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd288e7d-4293-47c5-a3c9-049ff6818e51 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:25 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd288e7d-4293-47c5-a3c9-049ff6818e51 Sep 06 08:09:25 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:26 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7c5d2da5-a105-406b-9f9d-3d397595c950 tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd288e7d-4293-47c5-a3c9-049ff6818e51" returned: 0 in 0.290s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7c5d2da5-a105-406b-9f9d-3d397595c950 tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-quobyte-dd288e7d-4293-47c5-a3c9-049ff6818e51" released by "delete_volume" :: held 0.746s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:26 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=136,cinder:UPDATE=156,cinder:DELETE=11,cinder:INSERT=41 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:09:26 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=123,cinder:UPDATE=163,cinder:INSERT=37,cinder:DELETE=16 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:09:26 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-7c5d2da5-a105-406b-9f9d-3d397595c950 tempest-VolumesDeleteCascade-220040628 None] Created reservations ['a50f2624-7025-47e7-b4c0-2c300405a941', '4dc288d9-8712-4158-bac6-12845033b7c4', 'fb2bbf27-a50a-4806-926b-2d126b7372cb', '95222874-ab78-4da2-9c15-73176555fa23'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:09:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7c5d2da5-a105-406b-9f9d-3d397595c950 tempest-VolumesDeleteCascade-220040628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7c5d2da5-a105-406b-9f9d-3d397595c950 tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:26 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7c5d2da5-a105-406b-9f9d-3d397595c950 tempest-VolumesDeleteCascade-220040628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:26 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7c5d2da5-a105-406b-9f9d-3d397595c950 tempest-VolumesDeleteCascade-220040628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7c5d2da5-a105-406b-9f9d-3d397595c950 tempest-VolumesDeleteCascade-220040628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7c5d2da5-a105-406b-9f9d-3d397595c950 tempest-VolumesDeleteCascade-220040628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:26 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:09:26 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:26 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-462b23b9-2a3d-4833-94fe-5badeb71f6af tempest-GroupsTest-417670066 None] Group tempest-Group2-282817164: creating Sep 06 08:09:26 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-462b23b9-2a3d-4833-94fe-5badeb71f6af tempest-GroupsTest-417670066 None] Group tempest-Group2-282817164: created successfully Sep 06 08:09:26 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-462b23b9-2a3d-4833-94fe-5badeb71f6af tempest-GroupsTest-417670066 None] Create group completed successfully. Sep 06 08:09:26 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7c5d2da5-a105-406b-9f9d-3d397595c950 tempest-VolumesDeleteCascade-220040628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.425s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:26 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-7c5d2da5-a105-406b-9f9d-3d397595c950 tempest-VolumesDeleteCascade-220040628 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:09:26 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-7c5d2da5-a105-406b-9f9d-3d397595c950 tempest-VolumesDeleteCascade-220040628 None] Deleted volume successfully. Sep 06 08:09:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7c5d2da5-a105-406b-9f9d-3d397595c950 tempest-VolumesDeleteCascade-220040628 None] Lock "cinder-dd288e7d-4293-47c5-a3c9-049ff6818e51-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:28 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:09:28 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Flow 'volume_create_manager' (96c4429f-d7ed-474d-ab70-1288b02b1a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:28 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4f6dd0-327f-43e7-bc96-a2fbe4e0f0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:28 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4f6dd0-327f-43e7-bc96-a2fbe4e0f0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-213419775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78a041e0-7e46-44ea-9f10-de715869530e,host='devstack@QuobyteHD#QuobyteHD',id=e6b6f7df-003c-4325-81f8-c565ecbeca44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9e8da8a8ff4d32b5651f00c83bc56b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:28Z,use_quota=True,user_id='2ddc2734989e4b78b8b72ee055bd0f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42816642-b969-4dd5-86c5-1bf595aa61fd),volume_type_id=42816642-b969-4dd5-86c5-1bf595aa61fd)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:28 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0aeb5c9-cc0c-4a7f-9037-9924030c58f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:28 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0aeb5c9-cc0c-4a7f-9037-9924030c58f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:28 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4bbdf50-74ea-47a0-be69-d336f905e804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:28 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4bbdf50-74ea-47a0-be69-d336f905e804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6b6f7df-003c-4325-81f8-c565ecbeca44', 'volume_name': 'volume-e6b6f7df-003c-4325-81f8-c565ecbeca44', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:28 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3bc829c-144c-436b-9c90-6b5b6c0840b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:28 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3bc829c-144c-436b-9c90-6b5b6c0840b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:28 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd19557-ae43-4adf-b2f0-fe2068d5b998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:28 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Volume e6b6f7df-003c-4325-81f8-c565ecbeca44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6b6f7df-003c-4325-81f8-c565ecbeca44', 'volume_size': 1} Sep 06 08:09:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:28 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=78a041e0-7e46-44ea-9f10-de715869530e,created_at=2026-09-06T06:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-213419775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78a041e0-7e46-44ea-9f10-de715869530e,host='devstack@QuobyteHD#QuobyteHD',id=e6b6f7df-003c-4325-81f8-c565ecbeca44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9e8da8a8ff4d32b5651f00c83bc56b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:28Z,use_quota=True,user_id='2ddc2734989e4b78b8b72ee055bd0f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42816642-b969-4dd5-86c5-1bf595aa61fd),volume_type_id=42816642-b969-4dd5-86c5-1bf595aa61fd)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:09:28 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Creating volume e6b6f7df-003c-4325-81f8-c565ecbeca44 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:09:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:28 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:28 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:28 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:09:28 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:09:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e6b6f7df-003c-4325-81f8-c565ecbeca44 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:28 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e6b6f7df-003c-4325-81f8-c565ecbeca44 1073741824 Sep 06 08:09:28 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:28 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e6b6f7df-003c-4325-81f8-c565ecbeca44 1073741824" returned: 0 in 0.571s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e6b6f7df-003c-4325-81f8-c565ecbeca44 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:29 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e6b6f7df-003c-4325-81f8-c565ecbeca44 Sep 06 08:09:29 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:29 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e6b6f7df-003c-4325-81f8-c565ecbeca44" returned: 0 in 0.314s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:09:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd19557-ae43-4adf-b2f0-fe2068d5b998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6b6f7df-003c-4325-81f8-c565ecbeca44', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9366eb80-1e47-4205-b5ca-173a05f122d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:29 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Volume volume-e6b6f7df-003c-4325-81f8-c565ecbeca44 (e6b6f7df-003c-4325-81f8-c565ecbeca44): created successfully Sep 06 08:09:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9366eb80-1e47-4205-b5ca-173a05f122d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Flow 'volume_create_manager' (96c4429f-d7ed-474d-ab70-1288b02b1a0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:29 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-8e9c5211-6d0a-42f3-8aaa-3e0a6346420c tempest-GroupsTest-417670066 None] Created volume successfully. Sep 06 08:09:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-741dbe23-9bac-474a-8299-364a482736f0 tempest-GroupsTest-417670066 None] Acquiring lock "cinder-quobyte-e6b6f7df-003c-4325-81f8-c565ecbeca44" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-741dbe23-9bac-474a-8299-364a482736f0 tempest-GroupsTest-417670066 None] Lock "cinder-quobyte-e6b6f7df-003c-4325-81f8-c565ecbeca44" acquired by "delete_volume" :: waited 0.027s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:31 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2c93d8-0034-406f-a7d9-d3e705af0abf]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-741dbe23-9bac-474a-8299-364a482736f0 tempest-GroupsTest-417670066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e6b6f7df-003c-4325-81f8-c565ecbeca44 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:31 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e6b6f7df-003c-4325-81f8-c565ecbeca44 Sep 06 08:09:31 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:32 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-741dbe23-9bac-474a-8299-364a482736f0 tempest-GroupsTest-417670066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e6b6f7df-003c-4325-81f8-c565ecbeca44" returned: 0 in 0.505s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-741dbe23-9bac-474a-8299-364a482736f0 tempest-GroupsTest-417670066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e6b6f7df-003c-4325-81f8-c565ecbeca44 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:32 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e6b6f7df-003c-4325-81f8-c565ecbeca44 Sep 06 08:09:32 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:32 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-741dbe23-9bac-474a-8299-364a482736f0 tempest-GroupsTest-417670066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e6b6f7df-003c-4325-81f8-c565ecbeca44" returned: 0 in 0.313s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:32 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-741dbe23-9bac-474a-8299-364a482736f0 tempest-GroupsTest-417670066 None] Lock "cinder-quobyte-e6b6f7df-003c-4325-81f8-c565ecbeca44" released by "delete_volume" :: held 0.900s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:32 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-741dbe23-9bac-474a-8299-364a482736f0 tempest-GroupsTest-417670066 None] Created reservations ['2c1709de-99ab-405f-bb8c-f5027b297bb8'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:09:32 devstack cinder-volume[87307]: WARNING cinder.quota [None req-741dbe23-9bac-474a-8299-364a482736f0 tempest-GroupsTest-417670066 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2068098495 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2068098495, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:09:32 devstack cinder-volume[87307]: WARNING cinder.quota [None req-741dbe23-9bac-474a-8299-364a482736f0 tempest-GroupsTest-417670066 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2068098495 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2068098495, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:09:32 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-741dbe23-9bac-474a-8299-364a482736f0 tempest-GroupsTest-417670066 None] Created reservations ['f31dde8f-dd31-415c-8983-c3fba439ea25', '204a5a1e-529f-441f-85aa-e2005f297b1f', '38534d1e-1eb3-4337-ab7a-4a30a10cb1eb', 'a1734575-139c-4e1c-87c6-4687ba387bb3'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:09:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-741dbe23-9bac-474a-8299-364a482736f0 tempest-GroupsTest-417670066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-741dbe23-9bac-474a-8299-364a482736f0 tempest-GroupsTest-417670066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-741dbe23-9bac-474a-8299-364a482736f0 tempest-GroupsTest-417670066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-741dbe23-9bac-474a-8299-364a482736f0 tempest-GroupsTest-417670066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-741dbe23-9bac-474a-8299-364a482736f0 tempest-GroupsTest-417670066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-741dbe23-9bac-474a-8299-364a482736f0 tempest-GroupsTest-417670066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:32 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:09:32 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:32 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:09:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Flow 'volume_create_manager' (8da17205-405e-4a23-9204-da6e3a10ffbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d9c33f-f6cc-495b-b765-20714dfe4438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d9c33f-f6cc-495b-b765-20714dfe4438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-71206799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c6e789-c12c-4245-aff3-9cd32a516799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d4f16aa2f1c4a0e822f7dc236b8a07a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:33Z,use_quota=True,user_id='37bcf6d9c3974dc8a91e095e0995e80c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f96be6b8-2180-4951-9eb2-7664117a2ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f96be6b8-2180-4951-9eb2-7664117a2ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17473d56-981f-4179-98d1-f5918f994e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.image.glance [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Creating Keystone auth plugin from conf {{(pid=87307) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 08:09:33 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-741dbe23-9bac-474a-8299-364a482736f0 tempest-GroupsTest-417670066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.447s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-741dbe23-9bac-474a-8299-364a482736f0 tempest-GroupsTest-417670066 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:09:33 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-741dbe23-9bac-474a-8299-364a482736f0 tempest-GroupsTest-417670066 None] Delete group completed successfully. Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-5392b84a-6d89-4c04-979c-57806c08a9ae tempest-GroupsTest-417670066 None] Created reservations ['d8bc539d-3b3a-4f91-95d1-a929dfa92280'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5392b84a-6d89-4c04-979c-57806c08a9ae tempest-GroupsTest-417670066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5392b84a-6d89-4c04-979c-57806c08a9ae tempest-GroupsTest-417670066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5392b84a-6d89-4c04-979c-57806c08a9ae tempest-GroupsTest-417670066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5392b84a-6d89-4c04-979c-57806c08a9ae tempest-GroupsTest-417670066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5392b84a-6d89-4c04-979c-57806c08a9ae tempest-GroupsTest-417670066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5392b84a-6d89-4c04-979c-57806c08a9ae tempest-GroupsTest-417670066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:33 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:09:33 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:33 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5392b84a-6d89-4c04-979c-57806c08a9ae tempest-GroupsTest-417670066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.399s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-5392b84a-6d89-4c04-979c-57806c08a9ae tempest-GroupsTest-417670066 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:09:33 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-5392b84a-6d89-4c04-979c-57806c08a9ae tempest-GroupsTest-417670066 None] Delete group completed successfully. Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17473d56-981f-4179-98d1-f5918f994e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '76c6e789-c12c-4245-aff3-9cd32a516799', 'volume_name': 'volume-76c6e789-c12c-4245-aff3-9cd32a516799', 'volume_size': 1, 'image_id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1531709cfd9f41a0b45e9cae3f8241b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'created_at': datetime.datetime(2026, 9, 6, 5, 57, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 5, 57, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b83bf489-67d1-4fbb-ae87-165ca90bf218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b83bf489-67d1-4fbb-ae87-165ca90bf218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e9956e-a0f6-4938-b3f8-e57f7e56c803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:33 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Volume 76c6e789-c12c-4245-aff3-9cd32a516799: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-76c6e789-c12c-4245-aff3-9cd32a516799', 'volume_size': 1, 'image_id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1531709cfd9f41a0b45e9cae3f8241b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'created_at': datetime.datetime(2026, 9, 6, 5, 57, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 5, 57, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Trying to clone 76c6e789-c12c-4245-aff3-9cd32a516799 from image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}]). {{(pid=87307) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Flow 'volume_create_manager' (1300927f-a4d5-4190-8daa-26dbf331f32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daeba4ac-bace-4396-be09-b57f565fbe8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daeba4ac-bace-4396-be09-b57f565fbe8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-704181533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2e5327-6577-480c-a2b1-e955ee2f3efd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75724fa1a4154d85a8b0a2f1b968dcf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:34Z,use_quota=True,user_id='37057b66d9394d44aa1b3a65db2cfee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0af924-101b-437a-a2f0-6c0921c31c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0af924-101b-437a-a2f0-6c0921c31c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd7dfd24-b25d-41af-ab4b-e95c75b60152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd7dfd24-b25d-41af-ab4b-e95c75b60152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f2e5327-6577-480c-a2b1-e955ee2f3efd', 'volume_name': 'volume-6f2e5327-6577-480c-a2b1-e955ee2f3efd', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60eeb8a2-a32f-46eb-a01d-5f8f4c689baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60eeb8a2-a32f-46eb-a01d-5f8f4c689baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4256db-6255-45d7-b13c-7719a889ce87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:33 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Volume 6f2e5327-6577-480c-a2b1-e955ee2f3efd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f2e5327-6577-480c-a2b1-e955ee2f3efd', 'volume_size': 1} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-704181533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2e5327-6577-480c-a2b1-e955ee2f3efd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75724fa1a4154d85a8b0a2f1b968dcf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:34Z,use_quota=True,user_id='37057b66d9394d44aa1b3a65db2cfee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Creating volume 6f2e5327-6577-480c-a2b1-e955ee2f3efd {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:09:33 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:09:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6f2e5327-6577-480c-a2b1-e955ee2f3efd 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:34 devstack sudo[95717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6f2e5327-6577-480c-a2b1-e955ee2f3efd 1073741824 Sep 06 08:09:34 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:34 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_p_ktv1n6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 08:09:34 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Image download 20.69 MB at 20.69 MB/s Sep 06 08:09:34 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f2d9d9-7029-4e03-b6fb-0d401fd42133]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_p_ktv1n6devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:34 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_p_ktv1n6devstack@QuobyteHD Sep 06 08:09:34 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:34 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6f2e5327-6577-480c-a2b1-e955ee2f3efd 1073741824" returned: 0 in 0.727s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6f2e5327-6577-480c-a2b1-e955ee2f3efd {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:34 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6f2e5327-6577-480c-a2b1-e955ee2f3efd Sep 06 08:09:34 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:35 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_p_ktv1n6devstack@QuobyteHD" returned: 0 in 0.525s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:35 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Temporary image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 is fetched for user 37bcf6d9c3974dc8a91e095e0995e80c. {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 08:09:35 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6f2e5327-6577-480c-a2b1-e955ee2f3efd" returned: 0 in 0.383s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:09:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4256db-6255-45d7-b13c-7719a889ce87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f2e5327-6577-480c-a2b1-e955ee2f3efd', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a43c132-1f90-43f0-9971-4a172026eab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:35 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[985bf9f7-8f6f-4a08-a0b8-7ea223d987c1]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_p_ktv1n6devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:35 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Volume volume-6f2e5327-6577-480c-a2b1-e955ee2f3efd (6f2e5327-6577-480c-a2b1-e955ee2f3efd): created successfully Sep 06 08:09:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a43c132-1f90-43f0-9971-4a172026eab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Flow 'volume_create_manager' (1300927f-a4d5-4190-8daa-26dbf331f32d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:35 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-af6453a0-f921-48b0-9e08-e3dd99bf2c3d tempest-GroupsTest-417670066 None] Group tempest-GroupsTest-Group-523025551: creating Sep 06 08:09:35 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-db505142-4574-485a-8844-e7e440b9fe24 tempest-VolumesListTestJSON-82639396 None] Created volume successfully. Sep 06 08:09:35 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-af6453a0-f921-48b0-9e08-e3dd99bf2c3d tempest-GroupsTest-417670066 None] Group tempest-GroupsTest-Group-523025551: created successfully Sep 06 08:09:35 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-af6453a0-f921-48b0-9e08-e3dd99bf2c3d tempest-GroupsTest-417670066 None] Create group completed successfully. Sep 06 08:09:35 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_p_ktv1n6devstack@QuobyteHD Sep 06 08:09:35 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:35 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_p_ktv1n6devstack@QuobyteHD" returned: 0 in 0.401s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-71206799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c6e789-c12c-4245-aff3-9cd32a516799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d4f16aa2f1c4a0e822f7dc236b8a07a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:33Z,use_quota=True,user_id='37bcf6d9c3974dc8a91e095e0995e80c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:09:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Creating volume 76c6e789-c12c-4245-aff3-9cd32a516799 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:09:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:09:35 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:09:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-76c6e789-c12c-4245-aff3-9cd32a516799 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:35 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-76c6e789-c12c-4245-aff3-9cd32a516799 1073741824 Sep 06 08:09:35 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:36 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-76c6e789-c12c-4245-aff3-9cd32a516799 1073741824" returned: 0 in 0.596s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-76c6e789-c12c-4245-aff3-9cd32a516799 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:36 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-76c6e789-c12c-4245-aff3-9cd32a516799 Sep 06 08:09:36 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:36 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-76c6e789-c12c-4245-aff3-9cd32a516799" returned: 0 in 0.298s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Attempting download of 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}])) to volume 76c6e789-c12c-4245-aff3-9cd32a516799. {{(pid=87307) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f593cc00-7df9-4e8d-84b6-a7993d19f9d9]: (4, 'raw') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_bf_k8qoi {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Flow 'volume_create_manager' (951210a8-5948-4138-818e-7f60a17f8862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8674791c-3853-4af8-9e65-b087bd63f6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:36 devstack sudo[95746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_bf_k8qoi Sep 06 08:09:36 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8674791c-3853-4af8-9e65-b087bd63f6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-523193566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b479fb-ef9d-4bd4-bb60-35d08b05b80e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75724fa1a4154d85a8b0a2f1b968dcf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:37Z,use_quota=True,user_id='37057b66d9394d44aa1b3a65db2cfee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae468363-06de-4c73-87fc-8f8c85d676f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae468363-06de-4c73-87fc-8f8c85d676f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8874f00b-054e-410d-bc81-1abf73b0e730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8874f00b-054e-410d-bc81-1abf73b0e730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08b479fb-ef9d-4bd4-bb60-35d08b05b80e', 'volume_name': 'volume-08b479fb-ef9d-4bd4-bb60-35d08b05b80e', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdc3d65-68e6-41b8-8aa3-15a3143211dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdc3d65-68e6-41b8-8aa3-15a3143211dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d6a5e3-df00-4bdf-908c-a619005e6481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:36 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Volume 08b479fb-ef9d-4bd4-bb60-35d08b05b80e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08b479fb-ef9d-4bd4-bb60-35d08b05b80e', 'volume_size': 1} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-523193566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b479fb-ef9d-4bd4-bb60-35d08b05b80e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75724fa1a4154d85a8b0a2f1b968dcf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:37Z,use_quota=True,user_id='37057b66d9394d44aa1b3a65db2cfee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Creating volume 08b479fb-ef9d-4bd4-bb60-35d08b05b80e {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:09:36 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:09:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-08b479fb-ef9d-4bd4-bb60-35d08b05b80e 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:36 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-08b479fb-ef9d-4bd4-bb60-35d08b05b80e 1073741824 Sep 06 08:09:36 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Flow 'volume_create_manager' (883e578c-fbc5-4f24-99f2-241de25ee447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:37 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c7568f-5e80-4b1c-9d0b-1fdcb466b5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_bf_k8qoi" returned: 0 in 0.551s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_bf_k8qoi {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c7568f-5e80-4b1c-9d0b-1fdcb466b5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1349713521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d78b8fee-880c-4073-87ba-1f0510a659fd,host='devstack@QuobyteHD#QuobyteHD',id=aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9e8da8a8ff4d32b5651f00c83bc56b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:37Z,use_quota=True,user_id='2ddc2734989e4b78b8b72ee055bd0f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2696db87-f726-4118-b646-2d4217f5b438),volume_type_id=2696db87-f726-4118-b646-2d4217f5b438)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f97012-f2b3-476c-9019-4b7815a30851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f97012-f2b3-476c-9019-4b7815a30851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b3ff7c7-d68a-4235-9a3a-efa22ee923cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b3ff7c7-d68a-4235-9a3a-efa22ee923cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4', 'volume_name': 'volume-aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba85858-ea53-49c6-854e-5092df7c72e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba85858-ea53-49c6-854e-5092df7c72e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4474eb0-f38a-463b-a27c-e7e558e4d76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:37 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Volume aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4', 'volume_size': 1} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:37 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_bf_k8qoi Sep 06 08:09:37 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:37 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-08b479fb-ef9d-4bd4-bb60-35d08b05b80e 1073741824" returned: 0 in 0.601s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-08b479fb-ef9d-4bd4-bb60-35d08b05b80e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:37 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-08b479fb-ef9d-4bd4-bb60-35d08b05b80e Sep 06 08:09:37 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:37 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_bf_k8qoi" returned: 1 in 0.370s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_bf_k8qoi' failed. Not Retrying. {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fab6158-9cc5-4f2b-bb16-180a7196e11b]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_p_ktv1n6devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:37 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_p_ktv1n6devstack@QuobyteHD Sep 06 08:09:37 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:37 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-08b479fb-ef9d-4bd4-bb60-35d08b05b80e" returned: 0 in 0.299s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.558s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d78b8fee-880c-4073-87ba-1f0510a659fd,created_at=2026-09-06T06:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1349713521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d78b8fee-880c-4073-87ba-1f0510a659fd,host='devstack@QuobyteHD#QuobyteHD',id=aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9e8da8a8ff4d32b5651f00c83bc56b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:37Z,use_quota=True,user_id='2ddc2734989e4b78b8b72ee055bd0f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2696db87-f726-4118-b646-2d4217f5b438),volume_type_id=2696db87-f726-4118-b646-2d4217f5b438)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Creating volume aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:09:37 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d6a5e3-df00-4bdf-908c-a619005e6481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08b479fb-ef9d-4bd4-bb60-35d08b05b80e', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ae63ac-a147-4bd6-93e3-b1999086ae74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:37 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Volume volume-08b479fb-ef9d-4bd4-bb60-35d08b05b80e (08b479fb-ef9d-4bd4-bb60-35d08b05b80e): created successfully Sep 06 08:09:37 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4 1073741824 Sep 06 08:09:37 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ae63ac-a147-4bd6-93e3-b1999086ae74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Flow 'volume_create_manager' (951210a8-5948-4138-818e-7f60a17f8862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:37 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-6cb27182-ed7c-4dc5-8c0e-d618d425e365 tempest-VolumesListTestJSON-82639396 None] Created volume successfully. Sep 06 08:09:38 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_p_ktv1n6devstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:38 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 was qcow2, converting to qcow2 {{(pid=87307) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 08:09:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_p_ktv1n6devstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-76c6e789-c12c-4245-aff3-9cd32a516799 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:38 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_p_ktv1n6devstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-76c6e789-c12c-4245-aff3-9cd32a516799 Sep 06 08:09:38 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:38 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4 1073741824" returned: 0 in 0.575s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:38 devstack sudo[95782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4 Sep 06 08:09:38 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:38 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4" returned: 0 in 0.324s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:38 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:09:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:38 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4474eb0-f38a-463b-a27c-e7e558e4d76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:38 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce4fb34b-3a24-4130-92f5-18935d6b82d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:38 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Volume volume-aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4 (aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4): created successfully Sep 06 08:09:38 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce4fb34b-3a24-4130-92f5-18935d6b82d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:38 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Flow 'volume_create_manager' (883e578c-fbc5-4f24-99f2-241de25ee447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:38 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-41a708d9-6ff3-42f5-a490-fd31195f71d1 tempest-GroupsTest-417670066 None] Created volume successfully. Sep 06 08:09:39 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:09:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Flow 'volume_create_manager' (be8df21c-7a36-4db1-a6b0-8006cb2a42cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3515b5c9-992f-47e5-8e18-a56dd2257c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3515b5c9-992f-47e5-8e18-a56dd2257c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-585312206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0666f80-d847-45b5-b3e8-8f16458848a6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75724fa1a4154d85a8b0a2f1b968dcf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:40Z,use_quota=True,user_id='37057b66d9394d44aa1b3a65db2cfee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec859cf-45d7-4f25-9b39-b1118f988685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec859cf-45d7-4f25-9b39-b1118f988685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c23fb4-6786-48cb-930d-12cf93a1cb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c23fb4-6786-48cb-930d-12cf93a1cb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0666f80-d847-45b5-b3e8-8f16458848a6', 'volume_name': 'volume-e0666f80-d847-45b5-b3e8-8f16458848a6', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a35221c-69f1-4807-98fd-567f74aa45d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a35221c-69f1-4807-98fd-567f74aa45d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad32c31d-b718-4ac3-b416-33ba4fb82cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:39 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Volume e0666f80-d847-45b5-b3e8-8f16458848a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0666f80-d847-45b5-b3e8-8f16458848a6', 'volume_size': 1} Sep 06 08:09:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-585312206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0666f80-d847-45b5-b3e8-8f16458848a6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75724fa1a4154d85a8b0a2f1b968dcf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:40Z,use_quota=True,user_id='37057b66d9394d44aa1b3a65db2cfee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:09:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Creating volume e0666f80-d847-45b5-b3e8-8f16458848a6 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:09:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:09:39 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:09:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e0666f80-d847-45b5-b3e8-8f16458848a6 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:39 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e0666f80-d847-45b5-b3e8-8f16458848a6 1073741824 Sep 06 08:09:39 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:40 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e0666f80-d847-45b5-b3e8-8f16458848a6 1073741824" returned: 0 in 0.596s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Flow 'volume_create_manager' (e446a7f1-cdb2-4615-b922-4e3e9ac6c0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01ff861-5794-4e87-bd0a-db39fc79b9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01ff861-5794-4e87-bd0a-db39fc79b9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-675306992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d78b8fee-880c-4073-87ba-1f0510a659fd,host='devstack@QuobyteHD#QuobyteHD',id=2765fdd2-6820-45e9-8f46-8e4dd8109ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9e8da8a8ff4d32b5651f00c83bc56b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:40Z,use_quota=True,user_id='2ddc2734989e4b78b8b72ee055bd0f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2696db87-f726-4118-b646-2d4217f5b438),volume_type_id=2696db87-f726-4118-b646-2d4217f5b438)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e3bde6-03d3-4b07-80f5-903e25270765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e3bde6-03d3-4b07-80f5-903e25270765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f326f4f1-23d2-4ba2-b6b9-c8f6ae163982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f326f4f1-23d2-4ba2-b6b9-c8f6ae163982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2765fdd2-6820-45e9-8f46-8e4dd8109ded', 'volume_name': 'volume-2765fdd2-6820-45e9-8f46-8e4dd8109ded', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2adbf8e1-d625-4d34-98b3-ae53aa40af2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:40 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2adbf8e1-d625-4d34-98b3-ae53aa40af2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb773801-3231-4711-b505-98acd84774e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:40 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Volume 2765fdd2-6820-45e9-8f46-8e4dd8109ded: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2765fdd2-6820-45e9-8f46-8e4dd8109ded', 'volume_size': 1} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e0666f80-d847-45b5-b3e8-8f16458848a6 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_p_ktv1n6devstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-76c6e789-c12c-4245-aff3-9cd32a516799" returned: 0 in 2.429s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_p_ktv1n6devstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-76c6e789-c12c-4245-aff3-9cd32a516799 {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:09:40 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Converted 112.00 MB image at 46.07 MB/s Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-76c6e789-c12c-4245-aff3-9cd32a516799 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:40 devstack sudo[95792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e0666f80-d847-45b5-b3e8-8f16458848a6 Sep 06 08:09:40 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-76c6e789-c12c-4245-aff3-9cd32a516799 1G Sep 06 08:09:40 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:40 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:40 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e0666f80-d847-45b5-b3e8-8f16458848a6" returned: 0 in 0.290s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.297s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d78b8fee-880c-4073-87ba-1f0510a659fd,created_at=2026-09-06T06:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-675306992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d78b8fee-880c-4073-87ba-1f0510a659fd,host='devstack@QuobyteHD#QuobyteHD',id=2765fdd2-6820-45e9-8f46-8e4dd8109ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9e8da8a8ff4d32b5651f00c83bc56b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:40Z,use_quota=True,user_id='2ddc2734989e4b78b8b72ee055bd0f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2696db87-f726-4118-b646-2d4217f5b438),volume_type_id=2696db87-f726-4118-b646-2d4217f5b438)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Creating volume 2765fdd2-6820-45e9-8f46-8e4dd8109ded {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:09:40 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2765fdd2-6820-45e9-8f46-8e4dd8109ded 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad32c31d-b718-4ac3-b416-33ba4fb82cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0666f80-d847-45b5-b3e8-8f16458848a6', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:40 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2765fdd2-6820-45e9-8f46-8e4dd8109ded 1073741824 Sep 06 08:09:40 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f77228e-e441-4d06-87f2-2c7f6c11a820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:40 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Volume volume-e0666f80-d847-45b5-b3e8-8f16458848a6 (e0666f80-d847-45b5-b3e8-8f16458848a6): created successfully Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f77228e-e441-4d06-87f2-2c7f6c11a820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Flow 'volume_create_manager' (be8df21c-7a36-4db1-a6b0-8006cb2a42cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:40 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-76c6e789-c12c-4245-aff3-9cd32a516799 1G" returned: 0 in 0.377s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Downloaded image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}])) to volume 76c6e789-c12c-4245-aff3-9cd32a516799 successfully. {{(pid=87307) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Temporary image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 for user 37bcf6d9c3974dc8a91e095e0995e80c is deleted. {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Marking volume 76c6e789-c12c-4245-aff3-9cd32a516799 as bootable. {{(pid=87307) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 08:09:40 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-bf1f0e3d-72ea-4524-bf7d-81414d355c3d tempest-VolumesListTestJSON-82639396 None] Created volume successfully. Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Copying metadata from image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 to 76c6e789-c12c-4245-aff3-9cd32a516799. {{(pid=87307) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 08:09:40 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Creating volume glance metadata for volume 76c6e789-c12c-4245-aff3-9cd32a516799 backed by image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87307) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 08:09:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e9956e-a0f6-4938-b3f8-e57f7e56c803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76c6e789-c12c-4245-aff3-9cd32a516799', 'volume_size': 1, 'image_id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1531709cfd9f41a0b45e9cae3f8241b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'created_at': datetime.datetime(2026, 9, 6, 5, 57, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 5, 57, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95474903-2447-4209-a104-5e71da080396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:41 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Volume volume-76c6e789-c12c-4245-aff3-9cd32a516799 (76c6e789-c12c-4245-aff3-9cd32a516799): created successfully Sep 06 08:09:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95474903-2447-4209-a104-5e71da080396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Flow 'volume_create_manager' (8da17205-405e-4a23-9204-da6e3a10ffbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:41 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-7badfbf0-8fa4-443d-a03c-dc8db69bc723 tempest-VolumesExtendTest-279787665 None] Created volume successfully. Sep 06 08:09:41 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2765fdd2-6820-45e9-8f46-8e4dd8109ded 1073741824" returned: 0 in 0.506s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2765fdd2-6820-45e9-8f46-8e4dd8109ded {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:41 devstack sudo[95807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2765fdd2-6820-45e9-8f46-8e4dd8109ded Sep 06 08:09:41 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:41 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2765fdd2-6820-45e9-8f46-8e4dd8109ded" returned: 0 in 0.288s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:09:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb773801-3231-4711-b505-98acd84774e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2765fdd2-6820-45e9-8f46-8e4dd8109ded', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6082c598-80b0-410e-9970-546a65619bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:41 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Volume volume-2765fdd2-6820-45e9-8f46-8e4dd8109ded (2765fdd2-6820-45e9-8f46-8e4dd8109ded): created successfully Sep 06 08:09:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6082c598-80b0-410e-9970-546a65619bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Flow 'volume_create_manager' (e446a7f1-cdb2-4615-b922-4e3e9ac6c0ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:41 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f2e1ea63-26ae-40c8-88aa-b603042fca1e tempest-GroupsTest-417670066 None] Created volume successfully. Sep 06 08:09:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6815151e-7576-4dd2-8af1-a8cb48340282 tempest-VolumesExtendTest-279787665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6815151e-7576-4dd2-8af1-a8cb48340282 tempest-VolumesExtendTest-279787665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:41 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b5b356-f3cb-4090-bffc-ef623ee62677]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6815151e-7576-4dd2-8af1-a8cb48340282 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-76c6e789-c12c-4245-aff3-9cd32a516799 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:42 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-76c6e789-c12c-4245-aff3-9cd32a516799 Sep 06 08:09:42 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:42 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6815151e-7576-4dd2-8af1-a8cb48340282 tempest-VolumesExtendTest-279787665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-76c6e789-c12c-4245-aff3-9cd32a516799" returned: 0 in 0.388s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6815151e-7576-4dd2-8af1-a8cb48340282 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-76c6e789-c12c-4245-aff3-9cd32a516799 2G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6815151e-7576-4dd2-8af1-a8cb48340282 tempest-VolumesExtendTest-279787665 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-76c6e789-c12c-4245-aff3-9cd32a516799 2G" returned: 0 in 0.125s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6815151e-7576-4dd2-8af1-a8cb48340282 tempest-VolumesExtendTest-279787665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.555s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:42 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-6815151e-7576-4dd2-8af1-a8cb48340282 tempest-VolumesExtendTest-279787665 None] Extend volume completed successfully. Sep 06 08:09:43 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-0523ddbb-3dd0-4947-88bb-b5bd7a55b09e tempest-GroupsTest-417670066 None] Update group completed successfully. Sep 06 08:09:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0e5ca2bf-5858-43c7-8fb0-43bcb901e7d7 tempest-VolumesExtendTest-279787665 None] Acquiring lock "cinder-76c6e789-c12c-4245-aff3-9cd32a516799-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0e5ca2bf-5858-43c7-8fb0-43bcb901e7d7 tempest-VolumesExtendTest-279787665 None] Lock "cinder-76c6e789-c12c-4245-aff3-9cd32a516799-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0e5ca2bf-5858-43c7-8fb0-43bcb901e7d7 tempest-VolumesExtendTest-279787665 None] Acquiring lock "cinder-quobyte-76c6e789-c12c-4245-aff3-9cd32a516799" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0e5ca2bf-5858-43c7-8fb0-43bcb901e7d7 tempest-VolumesExtendTest-279787665 None] Lock "cinder-quobyte-76c6e789-c12c-4245-aff3-9cd32a516799" acquired by "delete_volume" :: waited 0.026s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:43 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3909d69d-0ca0-43ab-9498-876396d7da53]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0e5ca2bf-5858-43c7-8fb0-43bcb901e7d7 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-76c6e789-c12c-4245-aff3-9cd32a516799 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:43 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-76c6e789-c12c-4245-aff3-9cd32a516799 Sep 06 08:09:43 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f7aa6ad8-a5d2-48c1-b25c-2aff3f916309 tempest-VolumesListTestJSON-82639396 None] Acquiring lock "cinder-e0666f80-d847-45b5-b3e8-8f16458848a6-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f7aa6ad8-a5d2-48c1-b25c-2aff3f916309 tempest-VolumesListTestJSON-82639396 None] Lock "cinder-e0666f80-d847-45b5-b3e8-8f16458848a6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f7aa6ad8-a5d2-48c1-b25c-2aff3f916309 tempest-VolumesListTestJSON-82639396 None] Acquiring lock "cinder-quobyte-e0666f80-d847-45b5-b3e8-8f16458848a6" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f7aa6ad8-a5d2-48c1-b25c-2aff3f916309 tempest-VolumesListTestJSON-82639396 None] Lock "cinder-quobyte-e0666f80-d847-45b5-b3e8-8f16458848a6" acquired by "delete_volume" :: waited 0.023s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:44 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e6c474-0d25-467f-9edb-0aeb733af758]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7aa6ad8-a5d2-48c1-b25c-2aff3f916309 tempest-VolumesListTestJSON-82639396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e0666f80-d847-45b5-b3e8-8f16458848a6 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:44 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0e5ca2bf-5858-43c7-8fb0-43bcb901e7d7 tempest-VolumesExtendTest-279787665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-76c6e789-c12c-4245-aff3-9cd32a516799" returned: 0 in 0.437s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0e5ca2bf-5858-43c7-8fb0-43bcb901e7d7 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-76c6e789-c12c-4245-aff3-9cd32a516799 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:44 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-76c6e789-c12c-4245-aff3-9cd32a516799 Sep 06 08:09:44 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:44 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e0666f80-d847-45b5-b3e8-8f16458848a6 Sep 06 08:09:44 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:44 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0e5ca2bf-5858-43c7-8fb0-43bcb901e7d7 tempest-VolumesExtendTest-279787665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-76c6e789-c12c-4245-aff3-9cd32a516799" returned: 0 in 0.333s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0e5ca2bf-5858-43c7-8fb0-43bcb901e7d7 tempest-VolumesExtendTest-279787665 None] Lock "cinder-quobyte-76c6e789-c12c-4245-aff3-9cd32a516799" released by "delete_volume" :: held 0.863s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:44 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-ca53bcd3-93b4-4fd4-8a10-f6797a5e01c5 tempest-GroupsTest-417670066 None] Update group completed successfully. Sep 06 08:09:44 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-0e5ca2bf-5858-43c7-8fb0-43bcb901e7d7 tempest-VolumesExtendTest-279787665 None] Created reservations ['a95c79d3-44cf-44c7-beca-d5d0b17a15f0', 'af51e615-3f86-469d-a43b-2d9271b031bc', '133d2731-d95c-4f3c-8e23-938ddf836f08', '885bb161-d084-41b7-9772-29db28d57ce4'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:09:44 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7aa6ad8-a5d2-48c1-b25c-2aff3f916309 tempest-VolumesListTestJSON-82639396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e0666f80-d847-45b5-b3e8-8f16458848a6" returned: 0 in 0.520s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7aa6ad8-a5d2-48c1-b25c-2aff3f916309 tempest-VolumesListTestJSON-82639396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e0666f80-d847-45b5-b3e8-8f16458848a6 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:44 devstack sudo[95874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e0666f80-d847-45b5-b3e8-8f16458848a6 Sep 06 08:09:44 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0e5ca2bf-5858-43c7-8fb0-43bcb901e7d7 tempest-VolumesExtendTest-279787665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0e5ca2bf-5858-43c7-8fb0-43bcb901e7d7 tempest-VolumesExtendTest-279787665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:44 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0e5ca2bf-5858-43c7-8fb0-43bcb901e7d7 tempest-VolumesExtendTest-279787665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:44 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0e5ca2bf-5858-43c7-8fb0-43bcb901e7d7 tempest-VolumesExtendTest-279787665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0e5ca2bf-5858-43c7-8fb0-43bcb901e7d7 tempest-VolumesExtendTest-279787665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0e5ca2bf-5858-43c7-8fb0-43bcb901e7d7 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:44 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:09:44 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:44 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7aa6ad8-a5d2-48c1-b25c-2aff3f916309 tempest-VolumesListTestJSON-82639396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e0666f80-d847-45b5-b3e8-8f16458848a6" returned: 0 in 0.333s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f7aa6ad8-a5d2-48c1-b25c-2aff3f916309 tempest-VolumesListTestJSON-82639396 None] Lock "cinder-quobyte-e0666f80-d847-45b5-b3e8-8f16458848a6" released by "delete_volume" :: held 0.914s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:44 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-f7aa6ad8-a5d2-48c1-b25c-2aff3f916309 tempest-VolumesListTestJSON-82639396 None] Created reservations ['aa4304e2-7b15-43bc-b68a-26db6e75b036', '7224f6d3-2f00-4bc4-bef0-e7badbeda24a', 'e8280d1e-6427-4ccb-b289-b6d21cbe4d6d', '17676b9f-5bb2-415a-928e-d03d2d0fd15e'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:09:45 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0e5ca2bf-5858-43c7-8fb0-43bcb901e7d7 tempest-VolumesExtendTest-279787665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.312s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:45 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-0e5ca2bf-5858-43c7-8fb0-43bcb901e7d7 tempest-VolumesExtendTest-279787665 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:09:45 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-0e5ca2bf-5858-43c7-8fb0-43bcb901e7d7 tempest-VolumesExtendTest-279787665 None] Deleted volume successfully. Sep 06 08:09:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0e5ca2bf-5858-43c7-8fb0-43bcb901e7d7 tempest-VolumesExtendTest-279787665 None] Lock "cinder-76c6e789-c12c-4245-aff3-9cd32a516799-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f7aa6ad8-a5d2-48c1-b25c-2aff3f916309 tempest-VolumesListTestJSON-82639396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f7aa6ad8-a5d2-48c1-b25c-2aff3f916309 tempest-VolumesListTestJSON-82639396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f7aa6ad8-a5d2-48c1-b25c-2aff3f916309 tempest-VolumesListTestJSON-82639396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f7aa6ad8-a5d2-48c1-b25c-2aff3f916309 tempest-VolumesListTestJSON-82639396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f7aa6ad8-a5d2-48c1-b25c-2aff3f916309 tempest-VolumesListTestJSON-82639396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7aa6ad8-a5d2-48c1-b25c-2aff3f916309 tempest-VolumesListTestJSON-82639396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:45 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:09:45 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ed46223f-1a17-4dfa-88ef-e1f6e95a1b27 tempest-VolumesListTestJSON-82639396 None] Acquiring lock "cinder-08b479fb-ef9d-4bd4-bb60-35d08b05b80e-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ed46223f-1a17-4dfa-88ef-e1f6e95a1b27 tempest-VolumesListTestJSON-82639396 None] Lock "cinder-08b479fb-ef9d-4bd4-bb60-35d08b05b80e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ed46223f-1a17-4dfa-88ef-e1f6e95a1b27 tempest-VolumesListTestJSON-82639396 None] Acquiring lock "cinder-quobyte-08b479fb-ef9d-4bd4-bb60-35d08b05b80e" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ed46223f-1a17-4dfa-88ef-e1f6e95a1b27 tempest-VolumesListTestJSON-82639396 None] Lock "cinder-quobyte-08b479fb-ef9d-4bd4-bb60-35d08b05b80e" acquired by "delete_volume" :: waited 0.013s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:45 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e76c522-c184-4598-b527-d2c42bb8303b]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed46223f-1a17-4dfa-88ef-e1f6e95a1b27 tempest-VolumesListTestJSON-82639396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-08b479fb-ef9d-4bd4-bb60-35d08b05b80e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:45 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7aa6ad8-a5d2-48c1-b25c-2aff3f916309 tempest-VolumesListTestJSON-82639396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.350s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:45 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-f7aa6ad8-a5d2-48c1-b25c-2aff3f916309 tempest-VolumesListTestJSON-82639396 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:09:45 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f7aa6ad8-a5d2-48c1-b25c-2aff3f916309 tempest-VolumesListTestJSON-82639396 None] Deleted volume successfully. Sep 06 08:09:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f7aa6ad8-a5d2-48c1-b25c-2aff3f916309 tempest-VolumesListTestJSON-82639396 None] Lock "cinder-e0666f80-d847-45b5-b3e8-8f16458848a6-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:45 devstack sudo[95882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-08b479fb-ef9d-4bd4-bb60-35d08b05b80e Sep 06 08:09:45 devstack sudo[95882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:45 devstack sudo[95882]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed46223f-1a17-4dfa-88ef-e1f6e95a1b27 tempest-VolumesListTestJSON-82639396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-08b479fb-ef9d-4bd4-bb60-35d08b05b80e" returned: 0 in 0.503s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed46223f-1a17-4dfa-88ef-e1f6e95a1b27 tempest-VolumesListTestJSON-82639396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-08b479fb-ef9d-4bd4-bb60-35d08b05b80e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:45 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-08b479fb-ef9d-4bd4-bb60-35d08b05b80e Sep 06 08:09:45 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:46 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed46223f-1a17-4dfa-88ef-e1f6e95a1b27 tempest-VolumesListTestJSON-82639396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-08b479fb-ef9d-4bd4-bb60-35d08b05b80e" returned: 0 in 0.509s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:46 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ed46223f-1a17-4dfa-88ef-e1f6e95a1b27 tempest-VolumesListTestJSON-82639396 None] Lock "cinder-quobyte-08b479fb-ef9d-4bd4-bb60-35d08b05b80e" released by "delete_volume" :: held 1.086s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:46 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-ed46223f-1a17-4dfa-88ef-e1f6e95a1b27 tempest-VolumesListTestJSON-82639396 None] Created reservations ['689eb73c-b9a9-4229-87b7-6ee74702ce93', '65f10a70-eea9-446a-865c-c8b2527d81ec', '2ba2f63f-27f0-43c9-95f7-681000dede84', '04d5d08b-4f6a-4f00-b60b-c43d1551396b'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:09:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ed46223f-1a17-4dfa-88ef-e1f6e95a1b27 tempest-VolumesListTestJSON-82639396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ed46223f-1a17-4dfa-88ef-e1f6e95a1b27 tempest-VolumesListTestJSON-82639396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ed46223f-1a17-4dfa-88ef-e1f6e95a1b27 tempest-VolumesListTestJSON-82639396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ed46223f-1a17-4dfa-88ef-e1f6e95a1b27 tempest-VolumesListTestJSON-82639396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ed46223f-1a17-4dfa-88ef-e1f6e95a1b27 tempest-VolumesListTestJSON-82639396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed46223f-1a17-4dfa-88ef-e1f6e95a1b27 tempest-VolumesListTestJSON-82639396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:46 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:09:46 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:46 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] Acquiring lock "cinder-quobyte-2765fdd2-6820-45e9-8f46-8e4dd8109ded" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:46 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] Lock "cinder-quobyte-2765fdd2-6820-45e9-8f46-8e4dd8109ded" acquired by "delete_volume" :: waited 0.027s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:46 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4481e3a-ba50-4a6b-af11-08d9338f9a21]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2765fdd2-6820-45e9-8f46-8e4dd8109ded {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:46 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:09:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Flow 'volume_create_manager' (3bdee2d7-6e4b-4267-a5e7-e7e1c7115bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba19cb7-9e7e-4671-9072-c842c5a5585b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba19cb7-9e7e-4671-9072-c842c5a5585b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-196910554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdd243a6-98d2-49d1-bd68-1da1964d32e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d4f16aa2f1c4a0e822f7dc236b8a07a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:47Z,use_quota=True,user_id='37bcf6d9c3974dc8a91e095e0995e80c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b62d0ceb-0c46-452b-ab69-5b270a47be45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:46 devstack sudo[95912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2765fdd2-6820-45e9-8f46-8e4dd8109ded Sep 06 08:09:46 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b62d0ceb-0c46-452b-ab69-5b270a47be45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d39d51-181a-47f0-ae05-21cccc5d348f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:46 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d39d51-181a-47f0-ae05-21cccc5d348f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdd243a6-98d2-49d1-bd68-1da1964d32e5', 'volume_name': 'volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cfcee6e-c8dc-49a6-a281-9aadfc6f3b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cfcee6e-c8dc-49a6-a281-9aadfc6f3b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98d00b7-b15c-4ccf-9ea6-afe038ea0a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:47 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Volume cdd243a6-98d2-49d1-bd68-1da1964d32e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5', 'volume_size': 1} Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-196910554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdd243a6-98d2-49d1-bd68-1da1964d32e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d4f16aa2f1c4a0e822f7dc236b8a07a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:09:47Z,use_quota=True,user_id='37bcf6d9c3974dc8a91e095e0995e80c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Creating volume cdd243a6-98d2-49d1-bd68-1da1964d32e5 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:09:47 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed46223f-1a17-4dfa-88ef-e1f6e95a1b27 tempest-VolumesListTestJSON-82639396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.373s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-ed46223f-1a17-4dfa-88ef-e1f6e95a1b27 tempest-VolumesListTestJSON-82639396 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:09:47 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-ed46223f-1a17-4dfa-88ef-e1f6e95a1b27 tempest-VolumesListTestJSON-82639396 None] Deleted volume successfully. Sep 06 08:09:47 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5 1073741824 Sep 06 08:09:47 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ed46223f-1a17-4dfa-88ef-e1f6e95a1b27 tempest-VolumesListTestJSON-82639396 None] Lock "cinder-08b479fb-ef9d-4bd4-bb60-35d08b05b80e-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:47 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2765fdd2-6820-45e9-8f46-8e4dd8109ded" returned: 0 in 0.438s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2765fdd2-6820-45e9-8f46-8e4dd8109ded {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:47 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2765fdd2-6820-45e9-8f46-8e4dd8109ded Sep 06 08:09:47 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:47 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2765fdd2-6820-45e9-8f46-8e4dd8109ded" returned: 0 in 0.297s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] Lock "cinder-quobyte-2765fdd2-6820-45e9-8f46-8e4dd8109ded" released by "delete_volume" :: held 0.803s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] Acquiring lock "cinder-quobyte-aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:47 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] Lock "cinder-quobyte-aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4" acquired by "delete_volume" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5 1073741824" returned: 0 in 0.580s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ba5b27-57eb-48b4-ac94-ab1b47bfdafe]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:47 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5 Sep 06 08:09:47 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-13995608-fe3e-4567-b71d-3b697da949eb tempest-VolumesListTestJSON-82639396 None] Acquiring lock "cinder-6f2e5327-6577-480c-a2b1-e955ee2f3efd-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:47 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4 Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-13995608-fe3e-4567-b71d-3b697da949eb tempest-VolumesListTestJSON-82639396 None] Lock "cinder-6f2e5327-6577-480c-a2b1-e955ee2f3efd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:47 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-13995608-fe3e-4567-b71d-3b697da949eb tempest-VolumesListTestJSON-82639396 None] Acquiring lock "cinder-quobyte-6f2e5327-6577-480c-a2b1-e955ee2f3efd" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-13995608-fe3e-4567-b71d-3b697da949eb tempest-VolumesListTestJSON-82639396 None] Lock "cinder-quobyte-6f2e5327-6577-480c-a2b1-e955ee2f3efd" acquired by "delete_volume" :: waited 0.021s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79ce906-6403-4cd7-9665-771f2d7bdf3c]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-13995608-fe3e-4567-b71d-3b697da949eb tempest-VolumesListTestJSON-82639396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6f2e5327-6577-480c-a2b1-e955ee2f3efd {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:48 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5" returned: 0 in 0.386s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:48 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:09:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98d00b7-b15c-4ccf-9ea6-afe038ea0a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c51fe874-6218-4501-9ab1-2357f85b1ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:09:48 devstack sudo[95934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6f2e5327-6577-480c-a2b1-e955ee2f3efd Sep 06 08:09:48 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:48 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Volume volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5 (cdd243a6-98d2-49d1-bd68-1da1964d32e5): created successfully Sep 06 08:09:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c51fe874-6218-4501-9ab1-2357f85b1ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:09:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Flow 'volume_create_manager' (3bdee2d7-6e4b-4267-a5e7-e7e1c7115bd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:09:48 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-064f5095-1152-4921-a385-3da7d427f8a2 tempest-VolumesExtendTest-279787665 None] Created volume successfully. Sep 06 08:09:48 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4" returned: 0 in 0.601s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:48 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4 Sep 06 08:09:48 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:48 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-13995608-fe3e-4567-b71d-3b697da949eb tempest-VolumesListTestJSON-82639396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6f2e5327-6577-480c-a2b1-e955ee2f3efd" returned: 0 in 0.642s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-13995608-fe3e-4567-b71d-3b697da949eb tempest-VolumesListTestJSON-82639396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6f2e5327-6577-480c-a2b1-e955ee2f3efd {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:48 devstack sudo[95959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6f2e5327-6577-480c-a2b1-e955ee2f3efd Sep 06 08:09:48 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:48 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4" returned: 0 in 0.448s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:48 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] Lock "cinder-quobyte-aa7ad0eb-2f4b-42e7-9be2-5ba2dd0f92e4" released by "delete_volume" :: held 1.143s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:48 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] Created reservations ['ac1f473d-78fb-4709-ad04-2eb5e3781b44'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:09:48 devstack cinder-volume[87307]: WARNING cinder.quota [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-943189838 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-943189838, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:09:48 devstack cinder-volume[87307]: WARNING cinder.quota [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-943189838 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-943189838, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:09:49 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] Created reservations ['fef99007-38b3-43cd-97c4-7986caf76644', '561d0ba9-2e8f-4635-a9ab-bb45b3ebcda8', '2af02637-9fe2-40d0-9aff-24470889c34a', 'f28a0eb7-75ef-4c2a-9d26-7b7b4fe06f9b'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:09:49 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-13995608-fe3e-4567-b71d-3b697da949eb tempest-VolumesListTestJSON-82639396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6f2e5327-6577-480c-a2b1-e955ee2f3efd" returned: 0 in 0.509s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:49 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-13995608-fe3e-4567-b71d-3b697da949eb tempest-VolumesListTestJSON-82639396 None] Lock "cinder-quobyte-6f2e5327-6577-480c-a2b1-e955ee2f3efd" released by "delete_volume" :: held 1.237s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:49 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-13995608-fe3e-4567-b71d-3b697da949eb tempest-VolumesListTestJSON-82639396 None] Created reservations ['6cc85160-0781-453c-ab6a-0c546604389e', 'aeec8343-653d-42d1-8231-93cfa8dd3fda', 'f7abd700-2df1-40a6-a607-87de4bc7910b', '7af22be2-19f4-4b52-b124-26ce4d5b142c'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:09:49 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] Created reservations ['ae3787c6-091a-449d-81f3-71cc1bf9402e', 'fadda267-b3af-441c-9c7d-1c7872a18e4e', '29514d17-e267-451b-acc7-e18fcd39cdef', '05d7fe2e-0df1-46f4-b038-dffb8472c6e5'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:09:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-13995608-fe3e-4567-b71d-3b697da949eb tempest-VolumesListTestJSON-82639396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-13995608-fe3e-4567-b71d-3b697da949eb tempest-VolumesListTestJSON-82639396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:49 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-13995608-fe3e-4567-b71d-3b697da949eb tempest-VolumesListTestJSON-82639396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:49 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-13995608-fe3e-4567-b71d-3b697da949eb tempest-VolumesListTestJSON-82639396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-13995608-fe3e-4567-b71d-3b697da949eb tempest-VolumesListTestJSON-82639396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-13995608-fe3e-4567-b71d-3b697da949eb tempest-VolumesListTestJSON-82639396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:49 devstack sudo[96016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:09:49 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d11de7c5-eeb9-4332-943f-d400e911a623 tempest-VolumesExtendTest-279787665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d11de7c5-eeb9-4332-943f-d400e911a623 tempest-VolumesExtendTest-279787665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:49 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-d11de7c5-eeb9-4332-943f-d400e911a623 tempest-VolumesExtendTest-279787665 None] Creating offline snapshot 6cb621bc-b79e-4e5d-bb5e-f246f06af26c of volume cdd243a6-98d2-49d1-bd68-1da1964d32e5 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:09:49 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a8d8e5-64c8-4f56-a17d-9af2420cadd0]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d11de7c5-eeb9-4332-943f-d400e911a623 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:49 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:50 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:50 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:09:50 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:50 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5 Sep 06 08:09:50 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:50 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-13995608-fe3e-4567-b71d-3b697da949eb tempest-VolumesListTestJSON-82639396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.481s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:50 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-13995608-fe3e-4567-b71d-3b697da949eb tempest-VolumesListTestJSON-82639396 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:09:50 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-13995608-fe3e-4567-b71d-3b697da949eb tempest-VolumesListTestJSON-82639396 None] Deleted volume successfully. Sep 06 08:09:50 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-13995608-fe3e-4567-b71d-3b697da949eb tempest-VolumesListTestJSON-82639396 None] Lock "cinder-6f2e5327-6577-480c-a2b1-e955ee2f3efd-delete_volume" released by "delete_volume" :: held 2.468s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:50 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.477s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:50 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:09:50 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-609837b1-d4c5-4644-bfc2-ff0c5039553b tempest-GroupsTest-417670066 None] Delete group completed successfully. Sep 06 08:09:50 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d11de7c5-eeb9-4332-943f-d400e911a623 tempest-VolumesExtendTest-279787665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5" returned: 0 in 0.652s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d11de7c5-eeb9-4332-943f-d400e911a623 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.6cb621bc-b79e-4e5d-bb5e-f246f06af26c 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:50 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.6cb621bc-b79e-4e5d-bb5e-f246f06af26c 1G Sep 06 08:09:50 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:51 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d11de7c5-eeb9-4332-943f-d400e911a623 tempest-VolumesExtendTest-279787665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.6cb621bc-b79e-4e5d-bb5e-f246f06af26c 1G" returned: 0 in 0.636s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d11de7c5-eeb9-4332-943f-d400e911a623 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.6cb621bc-b79e-4e5d-bb5e-f246f06af26c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:51 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.6cb621bc-b79e-4e5d-bb5e-f246f06af26c Sep 06 08:09:51 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:51 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d11de7c5-eeb9-4332-943f-d400e911a623 tempest-VolumesExtendTest-279787665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.6cb621bc-b79e-4e5d-bb5e-f246f06af26c" returned: 0 in 0.514s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:51 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-d11de7c5-eeb9-4332-943f-d400e911a623 tempest-VolumesExtendTest-279787665 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.6cb621bc-b79e-4e5d-bb5e-f246f06af26c is being set with open permissions: ugo+rw Sep 06 08:09:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d11de7c5-eeb9-4332-943f-d400e911a623 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.6cb621bc-b79e-4e5d-bb5e-f246f06af26c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:51 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.6cb621bc-b79e-4e5d-bb5e-f246f06af26c Sep 06 08:09:51 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:52 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d11de7c5-eeb9-4332-943f-d400e911a623 tempest-VolumesExtendTest-279787665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.6cb621bc-b79e-4e5d-bb5e-f246f06af26c" returned: 0 in 0.331s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d11de7c5-eeb9-4332-943f-d400e911a623 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:52 devstack sudo[96045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.info Sep 06 08:09:52 devstack sudo[96045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:52 devstack sudo[96045]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d11de7c5-eeb9-4332-943f-d400e911a623 tempest-VolumesExtendTest-279787665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.info" returned: 0 in 0.493s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:52 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-d11de7c5-eeb9-4332-943f-d400e911a623 tempest-VolumesExtendTest-279787665 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.info is being set with open permissions: ugo+rw Sep 06 08:09:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d11de7c5-eeb9-4332-943f-d400e911a623 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:52 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.info Sep 06 08:09:52 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:53 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d11de7c5-eeb9-4332-943f-d400e911a623 tempest-VolumesExtendTest-279787665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.info" returned: 0 in 0.514s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d11de7c5-eeb9-4332-943f-d400e911a623 tempest-VolumesExtendTest-279787665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.374s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:53 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-d11de7c5-eeb9-4332-943f-d400e911a623 tempest-VolumesExtendTest-279787665 None] Create snapshot completed successfully Sep 06 08:09:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7783290a-974b-45a7-aa39-a11eac47a300 tempest-VolumesExtendTest-279787665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7783290a-974b-45a7-aa39-a11eac47a300 tempest-VolumesExtendTest-279787665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:54 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[852ca27b-d4e9-4886-81ab-4ed006343cc2]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7783290a-974b-45a7-aa39-a11eac47a300 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:54 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5 Sep 06 08:09:54 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:54 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7783290a-974b-45a7-aa39-a11eac47a300 tempest-VolumesExtendTest-279787665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5" returned: 0 in 0.666s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7783290a-974b-45a7-aa39-a11eac47a300 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.6cb621bc-b79e-4e5d-bb5e-f246f06af26c 2G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7783290a-974b-45a7-aa39-a11eac47a300 tempest-VolumesExtendTest-279787665 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.6cb621bc-b79e-4e5d-bb5e-f246f06af26c 2G" returned: 0 in 0.167s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7783290a-974b-45a7-aa39-a11eac47a300 tempest-VolumesExtendTest-279787665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.883s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:55 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-7783290a-974b-45a7-aa39-a11eac47a300 tempest-VolumesExtendTest-279787665 None] Extend volume completed successfully. Sep 06 08:09:55 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-08957cf3-7575-456e-b789-1b6c512e20a3 tempest-VolumesExtendTest-279787665 None] Acquiring lock "cinder-6cb621bc-b79e-4e5d-bb5e-f246f06af26c-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:55 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-08957cf3-7575-456e-b789-1b6c512e20a3 tempest-VolumesExtendTest-279787665 None] Lock "cinder-6cb621bc-b79e-4e5d-bb5e-f246f06af26c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:55 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-08957cf3-7575-456e-b789-1b6c512e20a3 tempest-VolumesExtendTest-279787665 None] Acquiring lock "cinder-quobyte-cdd243a6-98d2-49d1-bd68-1da1964d32e5" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:55 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-08957cf3-7575-456e-b789-1b6c512e20a3 tempest-VolumesExtendTest-279787665 None] Lock "cinder-quobyte-cdd243a6-98d2-49d1-bd68-1da1964d32e5" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:55 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-08957cf3-7575-456e-b789-1b6c512e20a3 tempest-VolumesExtendTest-279787665 None] Acquiring lock "cinder-quobyte-6cb621bc-b79e-4e5d-bb5e-f246f06af26c" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:55 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-08957cf3-7575-456e-b789-1b6c512e20a3 tempest-VolumesExtendTest-279787665 None] Lock "cinder-quobyte-6cb621bc-b79e-4e5d-bb5e-f246f06af26c" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-08957cf3-7575-456e-b789-1b6c512e20a3 tempest-VolumesExtendTest-279787665 None] Deleting offline snapshot 6cb621bc-b79e-4e5d-bb5e-f246f06af26c of volume cdd243a6-98d2-49d1-bd68-1da1964d32e5 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:09:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-08957cf3-7575-456e-b789-1b6c512e20a3 tempest-VolumesExtendTest-279787665 None] snapshot_file for this snap is: volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.6cb621bc-b79e-4e5d-bb5e-f246f06af26c {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:09:55 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4cdc00-d147-4fc4-bc9d-5cf749ba21a5]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-08957cf3-7575-456e-b789-1b6c512e20a3 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.6cb621bc-b79e-4e5d-bb5e-f246f06af26c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:55 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.6cb621bc-b79e-4e5d-bb5e-f246f06af26c Sep 06 08:09:55 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:56 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-08957cf3-7575-456e-b789-1b6c512e20a3 tempest-VolumesExtendTest-279787665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.6cb621bc-b79e-4e5d-bb5e-f246f06af26c" returned: 0 in 0.593s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-08957cf3-7575-456e-b789-1b6c512e20a3 tempest-VolumesExtendTest-279787665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:09:56 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a623556f-5712-4666-bbb2-a88ee74c8805]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-08957cf3-7575-456e-b789-1b6c512e20a3 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:56 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5 Sep 06 08:09:56 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:56 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-08957cf3-7575-456e-b789-1b6c512e20a3 tempest-VolumesExtendTest-279787665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5" returned: 0 in 0.505s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-08957cf3-7575-456e-b789-1b6c512e20a3 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.6cb621bc-b79e-4e5d-bb5e-f246f06af26c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:56 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.6cb621bc-b79e-4e5d-bb5e-f246f06af26c Sep 06 08:09:56 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:57 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-08957cf3-7575-456e-b789-1b6c512e20a3 tempest-VolumesExtendTest-279787665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.6cb621bc-b79e-4e5d-bb5e-f246f06af26c" returned: 0 in 0.586s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-08957cf3-7575-456e-b789-1b6c512e20a3 tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.6cb621bc-b79e-4e5d-bb5e-f246f06af26c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:57 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.6cb621bc-b79e-4e5d-bb5e-f246f06af26c Sep 06 08:09:57 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:57 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-08957cf3-7575-456e-b789-1b6c512e20a3 tempest-VolumesExtendTest-279787665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5.6cb621bc-b79e-4e5d-bb5e-f246f06af26c" returned: 0 in 0.458s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-08957cf3-7575-456e-b789-1b6c512e20a3 tempest-VolumesExtendTest-279787665 None] Lock "cinder-quobyte-6cb621bc-b79e-4e5d-bb5e-f246f06af26c" released by "_delete_snapshot" :: held 2.328s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-08957cf3-7575-456e-b789-1b6c512e20a3 tempest-VolumesExtendTest-279787665 None] Lock "cinder-quobyte-cdd243a6-98d2-49d1-bd68-1da1964d32e5" released by "delete_snapshot" :: held 2.385s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:58 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-08957cf3-7575-456e-b789-1b6c512e20a3 tempest-VolumesExtendTest-279787665 None] Created reservations ['b78aaa74-373e-4562-a967-f265f3a12793', 'dd2d7ec3-507b-4918-b2e4-e1181fb85396', '519e9818-778d-479e-8ab4-4283c8a415d2', '4df25541-5a3c-4c49-9a2d-f2517800b5fe'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:09:58 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-08957cf3-7575-456e-b789-1b6c512e20a3 tempest-VolumesExtendTest-279787665 None] Delete snapshot completed successfully. Sep 06 08:09:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-08957cf3-7575-456e-b789-1b6c512e20a3 tempest-VolumesExtendTest-279787665 None] Lock "cinder-6cb621bc-b79e-4e5d-bb5e-f246f06af26c-delete_snapshot" released by "delete_snapshot" :: held 2.686s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:09:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6ee62d1a-0144-4d2a-aebf-a50f3642e08e tempest-VolumesExtendTest-279787665 None] Acquiring lock "cinder-cdd243a6-98d2-49d1-bd68-1da1964d32e5-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6ee62d1a-0144-4d2a-aebf-a50f3642e08e tempest-VolumesExtendTest-279787665 None] Lock "cinder-cdd243a6-98d2-49d1-bd68-1da1964d32e5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6ee62d1a-0144-4d2a-aebf-a50f3642e08e tempest-VolumesExtendTest-279787665 None] Acquiring lock "cinder-quobyte-cdd243a6-98d2-49d1-bd68-1da1964d32e5" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:09:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6ee62d1a-0144-4d2a-aebf-a50f3642e08e tempest-VolumesExtendTest-279787665 None] Lock "cinder-quobyte-cdd243a6-98d2-49d1-bd68-1da1964d32e5" acquired by "delete_volume" :: waited 0.034s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:09:59 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[457b59fc-8107-446c-ad44-4fb820363b38]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:09:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6ee62d1a-0144-4d2a-aebf-a50f3642e08e tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:59 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5 Sep 06 08:09:59 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:09:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:09:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:09:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:09:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:09:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:09:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:59 devstack sudo[96093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:09:59 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:09:59 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Sep 06 08:09:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6ee62d1a-0144-4d2a-aebf-a50f3642e08e tempest-VolumesExtendTest-279787665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5" returned: 0 in 0.696s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:09:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6ee62d1a-0144-4d2a-aebf-a50f3642e08e tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:09:59 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5 Sep 06 08:09:59 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:00 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.397s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:00 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:10:00 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager._thread_info {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:10:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread count: 28 {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 08:10:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread info: [<_MainThread(MainThread, started 139985167040640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:10:00 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6ee62d1a-0144-4d2a-aebf-a50f3642e08e tempest-VolumesExtendTest-279787665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cdd243a6-98d2-49d1-bd68-1da1964d32e5" returned: 0 in 0.413s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6ee62d1a-0144-4d2a-aebf-a50f3642e08e tempest-VolumesExtendTest-279787665 None] Lock "cinder-quobyte-cdd243a6-98d2-49d1-bd68-1da1964d32e5" released by "delete_volume" :: held 1.207s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:10:00 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-6ee62d1a-0144-4d2a-aebf-a50f3642e08e tempest-VolumesExtendTest-279787665 None] Created reservations ['03bef666-ee54-48d6-a2ec-d9db57411335', '0e1d8bdc-dab2-4b98-9776-ceee75f1f277', '88895c40-0e26-44ef-a1cd-fb086dd6b286', 'aee71330-c82f-4fd6-8d4a-ab43eadace80'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:10:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6ee62d1a-0144-4d2a-aebf-a50f3642e08e tempest-VolumesExtendTest-279787665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6ee62d1a-0144-4d2a-aebf-a50f3642e08e tempest-VolumesExtendTest-279787665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6ee62d1a-0144-4d2a-aebf-a50f3642e08e tempest-VolumesExtendTest-279787665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:10:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6ee62d1a-0144-4d2a-aebf-a50f3642e08e tempest-VolumesExtendTest-279787665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:10:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6ee62d1a-0144-4d2a-aebf-a50f3642e08e tempest-VolumesExtendTest-279787665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6ee62d1a-0144-4d2a-aebf-a50f3642e08e tempest-VolumesExtendTest-279787665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:00 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:10:00 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:00 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6ee62d1a-0144-4d2a-aebf-a50f3642e08e tempest-VolumesExtendTest-279787665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.295s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:00 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6ee62d1a-0144-4d2a-aebf-a50f3642e08e tempest-VolumesExtendTest-279787665 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:10:00 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-6ee62d1a-0144-4d2a-aebf-a50f3642e08e tempest-VolumesExtendTest-279787665 None] Deleted volume successfully. Sep 06 08:10:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6ee62d1a-0144-4d2a-aebf-a50f3642e08e tempest-VolumesExtendTest-279787665 None] Lock "cinder-cdd243a6-98d2-49d1-bd68-1da1964d32e5-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:10:08 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:10:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Flow 'volume_create_manager' (d5f30e14-1438-4e1c-9f3c-ad184c6d1702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:10:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8588ab-7d20-4151-b2ff-2c5b8537846b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8588ab-7d20-4151-b2ff-2c5b8537846b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-335955374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d1f201-7e10-4b37-83dd-b27acafd27ee,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='79a47a9504e64f8e84eefdbd2b49e415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:10:09Z,use_quota=True,user_id='24876789eae14ecca338ffff08d91140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4584d1a7-f000-4d7d-a7a0-0484d3e0f049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4584d1a7-f000-4d7d-a7a0-0484d3e0f049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b184f9ad-1a51-4ed6-8aa4-f7a783098684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b184f9ad-1a51-4ed6-8aa4-f7a783098684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7d1f201-7e10-4b37-83dd-b27acafd27ee', 'volume_name': 'volume-b7d1f201-7e10-4b37-83dd-b27acafd27ee', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d6359b4-d755-41aa-bb27-fe71c8f86594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d6359b4-d755-41aa-bb27-fe71c8f86594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643836e3-6862-4ca9-9d95-9da106d1fe3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:08 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Volume b7d1f201-7e10-4b37-83dd-b27acafd27ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7d1f201-7e10-4b37-83dd-b27acafd27ee', 'volume_size': 1} Sep 06 08:10:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:08 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-335955374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d1f201-7e10-4b37-83dd-b27acafd27ee,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='79a47a9504e64f8e84eefdbd2b49e415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:10:09Z,use_quota=True,user_id='24876789eae14ecca338ffff08d91140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:10:08 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Creating volume b7d1f201-7e10-4b37-83dd-b27acafd27ee {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:10:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:08 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:10:08 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:10:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:08 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:10:08 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:10:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b7d1f201-7e10-4b37-83dd-b27acafd27ee 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:08 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b7d1f201-7e10-4b37-83dd-b27acafd27ee 1073741824 Sep 06 08:10:08 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:09 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b7d1f201-7e10-4b37-83dd-b27acafd27ee 1073741824" returned: 0 in 0.515s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b7d1f201-7e10-4b37-83dd-b27acafd27ee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:09 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b7d1f201-7e10-4b37-83dd-b27acafd27ee Sep 06 08:10:09 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:09 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b7d1f201-7e10-4b37-83dd-b27acafd27ee" returned: 0 in 0.265s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:09 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:10:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:09 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643836e3-6862-4ca9-9d95-9da106d1fe3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7d1f201-7e10-4b37-83dd-b27acafd27ee', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:09 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e3a26a-8ace-4c4b-aa13-a0789beb67b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:09 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Volume volume-b7d1f201-7e10-4b37-83dd-b27acafd27ee (b7d1f201-7e10-4b37-83dd-b27acafd27ee): created successfully Sep 06 08:10:09 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e3a26a-8ace-4c4b-aa13-a0789beb67b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:09 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Flow 'volume_create_manager' (d5f30e14-1438-4e1c-9f3c-ad184c6d1702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:10:09 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-6412c151-948e-46cb-a9a0-ca38f6dbb8ed tempest-VolumesGetTest-280735193 None] Created volume successfully. Sep 06 08:10:10 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:10:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Flow 'volume_create_manager' (c0f6aa77-14f1-415c-afaa-bcabdf6de567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:10:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93924024-43cf-4c85-9ecb-3661c7eceeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93924024-43cf-4c85-9ecb-3661c7eceeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-140014186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c47e1f6-d1a3-46d9-b576-b1584287e3ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45cd6b87c5f744b5b74e2610d598d8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:10:11Z,use_quota=True,user_id='28f3c2a07fb7429d9ec968a673a9b2f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e3edb8-b17e-4fa1-a32c-25d7559e2d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e3edb8-b17e-4fa1-a32c-25d7559e2d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2605143-b29f-4779-8a74-245d1f832508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2605143-b29f-4779-8a74-245d1f832508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c47e1f6-d1a3-46d9-b576-b1584287e3ee', 'volume_name': 'volume-7c47e1f6-d1a3-46d9-b576-b1584287e3ee', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d54348d6-a759-4f06-ac2c-03c509365b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d54348d6-a759-4f06-ac2c-03c509365b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb4f300-ea26-4c1c-b238-8f3dc17ca409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:10 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Volume 7c47e1f6-d1a3-46d9-b576-b1584287e3ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c47e1f6-d1a3-46d9-b576-b1584287e3ee', 'volume_size': 1} Sep 06 08:10:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-140014186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c47e1f6-d1a3-46d9-b576-b1584287e3ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45cd6b87c5f744b5b74e2610d598d8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:10:11Z,use_quota=True,user_id='28f3c2a07fb7429d9ec968a673a9b2f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:10:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Creating volume 7c47e1f6-d1a3-46d9-b576-b1584287e3ee {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:10:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:10:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:10:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:10:10 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:10:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7c47e1f6-d1a3-46d9-b576-b1584287e3ee 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:10 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7c47e1f6-d1a3-46d9-b576-b1584287e3ee 1073741824 Sep 06 08:10:10 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:11 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7c47e1f6-d1a3-46d9-b576-b1584287e3ee 1073741824" returned: 0 in 0.483s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7c47e1f6-d1a3-46d9-b576-b1584287e3ee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:11 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7c47e1f6-d1a3-46d9-b576-b1584287e3ee Sep 06 08:10:11 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:10:11 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Flow 'volume_create_manager' (93662ed3-f001-4554-a31d-5a725526e2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66fcdf08-dd94-48fd-af3b-e3d01020384e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7c47e1f6-d1a3-46d9-b576-b1584287e3ee" returned: 0 in 0.370s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66fcdf08-dd94-48fd-af3b-e3d01020384e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:10:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1662602003',display_name='tempest-VolumesGetTest-Volume-1127608012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c1fddfa-63da-4b14-af95-73ab7b940a79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a47a9504e64f8e84eefdbd2b49e415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:10:12Z,use_quota=True,user_id='24876789eae14ecca338ffff08d91140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a8a87f-36c2-4f86-b782-b44c3018427f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a8a87f-36c2-4f86-b782-b44c3018427f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2768013e-00d8-4fc2-aac2-c7bfc6f55e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2768013e-00d8-4fc2-aac2-c7bfc6f55e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c1fddfa-63da-4b14-af95-73ab7b940a79', 'volume_name': 'volume-8c1fddfa-63da-4b14-af95-73ab7b940a79', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5dbd5ec-ff88-46a5-8a19-eda1770ddd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5dbd5ec-ff88-46a5-8a19-eda1770ddd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46818bf2-45cd-4a09-b493-4280b28207bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:11 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Volume 8c1fddfa-63da-4b14-af95-73ab7b940a79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c1fddfa-63da-4b14-af95-73ab7b940a79', 'volume_size': 1} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:10:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1662602003',display_name='tempest-VolumesGetTest-Volume-1127608012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c1fddfa-63da-4b14-af95-73ab7b940a79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a47a9504e64f8e84eefdbd2b49e415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:10:12Z,use_quota=True,user_id='24876789eae14ecca338ffff08d91140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Creating volume 8c1fddfa-63da-4b14-af95-73ab7b940a79 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:10:11 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8c1fddfa-63da-4b14-af95-73ab7b940a79 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb4f300-ea26-4c1c-b238-8f3dc17ca409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c47e1f6-d1a3-46d9-b576-b1584287e3ee', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be78e3d-e46a-4df5-99d7-ba4f391e7cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:11 devstack sudo[96158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8c1fddfa-63da-4b14-af95-73ab7b940a79 1073741824 Sep 06 08:10:11 devstack sudo[96158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:11 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Volume volume-7c47e1f6-d1a3-46d9-b576-b1584287e3ee (7c47e1f6-d1a3-46d9-b576-b1584287e3ee): created successfully Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be78e3d-e46a-4df5-99d7-ba4f391e7cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Flow 'volume_create_manager' (c0f6aa77-14f1-415c-afaa-bcabdf6de567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:10:11 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-bc185534-513a-412c-be34-0509032798fa tempest-VolumeQuotasNegativeTestJSON-223226043 None] Created volume successfully. Sep 06 08:10:12 devstack sudo[96158]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8c1fddfa-63da-4b14-af95-73ab7b940a79 1073741824" returned: 0 in 0.613s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8c1fddfa-63da-4b14-af95-73ab7b940a79 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:12 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8c1fddfa-63da-4b14-af95-73ab7b940a79 Sep 06 08:10:12 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:12 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8c1fddfa-63da-4b14-af95-73ab7b940a79" returned: 0 in 0.302s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:12 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:10:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46818bf2-45cd-4a09-b493-4280b28207bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c1fddfa-63da-4b14-af95-73ab7b940a79', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384a3ea8-4631-4171-a425-1b236a13c2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:12 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Volume volume-8c1fddfa-63da-4b14-af95-73ab7b940a79 (8c1fddfa-63da-4b14-af95-73ab7b940a79): created successfully Sep 06 08:10:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384a3ea8-4631-4171-a425-1b236a13c2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Flow 'volume_create_manager' (93662ed3-f001-4554-a31d-5a725526e2fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:10:12 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-38c54fef-c40e-46a3-aff3-867ee93100fe tempest-VolumesGetTest-280735193 None] Created volume successfully. Sep 06 08:10:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c731fc0a-bcbb-48b6-aa22-79bd9e0162ea tempest-VolumesGetTest-280735193 None] Acquiring lock "cinder-8c1fddfa-63da-4b14-af95-73ab7b940a79-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:10:14 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c731fc0a-bcbb-48b6-aa22-79bd9e0162ea tempest-VolumesGetTest-280735193 None] Lock "cinder-8c1fddfa-63da-4b14-af95-73ab7b940a79-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:10:14 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c731fc0a-bcbb-48b6-aa22-79bd9e0162ea tempest-VolumesGetTest-280735193 None] Acquiring lock "cinder-quobyte-8c1fddfa-63da-4b14-af95-73ab7b940a79" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:10:14 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c731fc0a-bcbb-48b6-aa22-79bd9e0162ea tempest-VolumesGetTest-280735193 None] Lock "cinder-quobyte-8c1fddfa-63da-4b14-af95-73ab7b940a79" acquired by "delete_volume" :: waited 0.024s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:10:14 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7600fee-53de-4497-823f-92b9545a9b8c]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:10:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c731fc0a-bcbb-48b6-aa22-79bd9e0162ea tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8c1fddfa-63da-4b14-af95-73ab7b940a79 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:14 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-630df8b9-81d7-49f1-8244-67d1c99ff9a6 tempest-VolumeQuotasNegativeTestJSON-223226043 None] Acquiring lock "cinder-7c47e1f6-d1a3-46d9-b576-b1584287e3ee-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:10:14 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8c1fddfa-63da-4b14-af95-73ab7b940a79 Sep 06 08:10:14 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:14 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-630df8b9-81d7-49f1-8244-67d1c99ff9a6 tempest-VolumeQuotasNegativeTestJSON-223226043 None] Lock "cinder-7c47e1f6-d1a3-46d9-b576-b1584287e3ee-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:10:14 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-630df8b9-81d7-49f1-8244-67d1c99ff9a6 tempest-VolumeQuotasNegativeTestJSON-223226043 None] Acquiring lock "cinder-quobyte-7c47e1f6-d1a3-46d9-b576-b1584287e3ee" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:10:14 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-630df8b9-81d7-49f1-8244-67d1c99ff9a6 tempest-VolumeQuotasNegativeTestJSON-223226043 None] Lock "cinder-quobyte-7c47e1f6-d1a3-46d9-b576-b1584287e3ee" acquired by "delete_volume" :: waited 0.017s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:10:14 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dab5ae9-6b32-4e2d-829a-d328e433ff1c]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:10:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-630df8b9-81d7-49f1-8244-67d1c99ff9a6 tempest-VolumeQuotasNegativeTestJSON-223226043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7c47e1f6-d1a3-46d9-b576-b1584287e3ee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:14 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7c47e1f6-d1a3-46d9-b576-b1584287e3ee Sep 06 08:10:14 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:14 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c731fc0a-bcbb-48b6-aa22-79bd9e0162ea tempest-VolumesGetTest-280735193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8c1fddfa-63da-4b14-af95-73ab7b940a79" returned: 0 in 0.555s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c731fc0a-bcbb-48b6-aa22-79bd9e0162ea tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8c1fddfa-63da-4b14-af95-73ab7b940a79 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:14 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8c1fddfa-63da-4b14-af95-73ab7b940a79 Sep 06 08:10:14 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:14 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-630df8b9-81d7-49f1-8244-67d1c99ff9a6 tempest-VolumeQuotasNegativeTestJSON-223226043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7c47e1f6-d1a3-46d9-b576-b1584287e3ee" returned: 0 in 0.439s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-630df8b9-81d7-49f1-8244-67d1c99ff9a6 tempest-VolumeQuotasNegativeTestJSON-223226043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7c47e1f6-d1a3-46d9-b576-b1584287e3ee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:14 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7c47e1f6-d1a3-46d9-b576-b1584287e3ee Sep 06 08:10:14 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:15 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c731fc0a-bcbb-48b6-aa22-79bd9e0162ea tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8c1fddfa-63da-4b14-af95-73ab7b940a79" returned: 0 in 0.299s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:15 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c731fc0a-bcbb-48b6-aa22-79bd9e0162ea tempest-VolumesGetTest-280735193 None] Lock "cinder-quobyte-8c1fddfa-63da-4b14-af95-73ab7b940a79" released by "delete_volume" :: held 0.928s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:10:15 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-c731fc0a-bcbb-48b6-aa22-79bd9e0162ea tempest-VolumesGetTest-280735193 None] Created reservations ['15aecb8d-cd28-412a-b739-5cd5dd11aacb', 'e8e57cc6-d4ad-4bfb-be7c-b694594ac8a7', 'e3e2bb14-2d4b-494d-b12d-d8900a65245d', '0e255a41-7b0d-479e-aaae-b4ee5fc3572b'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:10:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c731fc0a-bcbb-48b6-aa22-79bd9e0162ea tempest-VolumesGetTest-280735193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c731fc0a-bcbb-48b6-aa22-79bd9e0162ea tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:15 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c731fc0a-bcbb-48b6-aa22-79bd9e0162ea tempest-VolumesGetTest-280735193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:10:15 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c731fc0a-bcbb-48b6-aa22-79bd9e0162ea tempest-VolumesGetTest-280735193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:10:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c731fc0a-bcbb-48b6-aa22-79bd9e0162ea tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c731fc0a-bcbb-48b6-aa22-79bd9e0162ea tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:15 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-630df8b9-81d7-49f1-8244-67d1c99ff9a6 tempest-VolumeQuotasNegativeTestJSON-223226043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7c47e1f6-d1a3-46d9-b576-b1584287e3ee" returned: 0 in 0.326s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:15 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-630df8b9-81d7-49f1-8244-67d1c99ff9a6 tempest-VolumeQuotasNegativeTestJSON-223226043 None] Lock "cinder-quobyte-7c47e1f6-d1a3-46d9-b576-b1584287e3ee" released by "delete_volume" :: held 0.815s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:10:15 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:10:15 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:15 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-630df8b9-81d7-49f1-8244-67d1c99ff9a6 tempest-VolumeQuotasNegativeTestJSON-223226043 None] Created reservations ['bffefcd3-69c9-4b29-aff5-39d08be03d2c', '77d1bd5b-e351-4546-bdab-631aa384f5b7', '1f7d85e6-a00e-4eba-9e13-ce1121f836d5', 'e9d148c8-aaea-4313-819c-e804c5e85e04'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:10:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-630df8b9-81d7-49f1-8244-67d1c99ff9a6 tempest-VolumeQuotasNegativeTestJSON-223226043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-630df8b9-81d7-49f1-8244-67d1c99ff9a6 tempest-VolumeQuotasNegativeTestJSON-223226043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:15 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-630df8b9-81d7-49f1-8244-67d1c99ff9a6 tempest-VolumeQuotasNegativeTestJSON-223226043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:10:15 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-630df8b9-81d7-49f1-8244-67d1c99ff9a6 tempest-VolumeQuotasNegativeTestJSON-223226043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:10:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-630df8b9-81d7-49f1-8244-67d1c99ff9a6 tempest-VolumeQuotasNegativeTestJSON-223226043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-630df8b9-81d7-49f1-8244-67d1c99ff9a6 tempest-VolumeQuotasNegativeTestJSON-223226043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:15 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:10:15 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:15 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c731fc0a-bcbb-48b6-aa22-79bd9e0162ea tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.397s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:15 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-c731fc0a-bcbb-48b6-aa22-79bd9e0162ea tempest-VolumesGetTest-280735193 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:10:15 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-c731fc0a-bcbb-48b6-aa22-79bd9e0162ea tempest-VolumesGetTest-280735193 None] Deleted volume successfully. Sep 06 08:10:15 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c731fc0a-bcbb-48b6-aa22-79bd9e0162ea tempest-VolumesGetTest-280735193 None] Lock "cinder-8c1fddfa-63da-4b14-af95-73ab7b940a79-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:10:15 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-630df8b9-81d7-49f1-8244-67d1c99ff9a6 tempest-VolumeQuotasNegativeTestJSON-223226043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.352s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:15 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-630df8b9-81d7-49f1-8244-67d1c99ff9a6 tempest-VolumeQuotasNegativeTestJSON-223226043 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:10:15 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-630df8b9-81d7-49f1-8244-67d1c99ff9a6 tempest-VolumeQuotasNegativeTestJSON-223226043 None] Deleted volume successfully. Sep 06 08:10:15 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-630df8b9-81d7-49f1-8244-67d1c99ff9a6 tempest-VolumeQuotasNegativeTestJSON-223226043 None] Lock "cinder-7c47e1f6-d1a3-46d9-b576-b1584287e3ee-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:10:16 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-728f6eb6-dc6a-4edb-89be-fd76714e565e tempest-VolumesGetTest-280735193 None] Acquiring lock "cinder-b7d1f201-7e10-4b37-83dd-b27acafd27ee-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:10:16 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-728f6eb6-dc6a-4edb-89be-fd76714e565e tempest-VolumesGetTest-280735193 None] Lock "cinder-b7d1f201-7e10-4b37-83dd-b27acafd27ee-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:10:16 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-728f6eb6-dc6a-4edb-89be-fd76714e565e tempest-VolumesGetTest-280735193 None] Acquiring lock "cinder-quobyte-b7d1f201-7e10-4b37-83dd-b27acafd27ee" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:10:16 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-728f6eb6-dc6a-4edb-89be-fd76714e565e tempest-VolumesGetTest-280735193 None] Lock "cinder-quobyte-b7d1f201-7e10-4b37-83dd-b27acafd27ee" acquired by "delete_volume" :: waited 0.026s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:10:16 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f44f7fa-42fa-4fc4-b2fc-530f3570f7ea]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:10:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-728f6eb6-dc6a-4edb-89be-fd76714e565e tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b7d1f201-7e10-4b37-83dd-b27acafd27ee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:16 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b7d1f201-7e10-4b37-83dd-b27acafd27ee Sep 06 08:10:16 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:16 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:10:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Flow 'volume_create_manager' (f060c911-df19-4a87-90f9-19fbe614f33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:10:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673dbc08-d25c-4c2b-b49a-3ade8519f5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673dbc08-d25c-4c2b-b49a-3ade8519f5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1509698410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f393d507-c01e-4301-9e45-30759269421c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9744cd0efc514feb9fbd9c01c7dc5172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:10:17Z,use_quota=True,user_id='aa6ff475541c4943bced009193f3b662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (265e606b-1729-4c34-9d3f-5b657f2f52e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (265e606b-1729-4c34-9d3f-5b657f2f52e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b87e4b7-0221-41da-b811-260adf971ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b87e4b7-0221-41da-b811-260adf971ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f393d507-c01e-4301-9e45-30759269421c', 'volume_name': 'volume-f393d507-c01e-4301-9e45-30759269421c', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66d2297-11cd-4e9b-b62d-baed4e8e9ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66d2297-11cd-4e9b-b62d-baed4e8e9ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be82a522-9cbc-4b98-9e83-4584e0b21fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:17 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:17 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Volume f393d507-c01e-4301-9e45-30759269421c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f393d507-c01e-4301-9e45-30759269421c', 'volume_size': 1} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1509698410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f393d507-c01e-4301-9e45-30759269421c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9744cd0efc514feb9fbd9c01c7dc5172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:10:17Z,use_quota=True,user_id='aa6ff475541c4943bced009193f3b662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Creating volume f393d507-c01e-4301-9e45-30759269421c {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:10:17 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f393d507-c01e-4301-9e45-30759269421c 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-728f6eb6-dc6a-4edb-89be-fd76714e565e tempest-VolumesGetTest-280735193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b7d1f201-7e10-4b37-83dd-b27acafd27ee" returned: 0 in 0.578s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-728f6eb6-dc6a-4edb-89be-fd76714e565e tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b7d1f201-7e10-4b37-83dd-b27acafd27ee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:17 devstack sudo[96206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f393d507-c01e-4301-9e45-30759269421c 1073741824 Sep 06 08:10:17 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:17 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b7d1f201-7e10-4b37-83dd-b27acafd27ee Sep 06 08:10:17 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:17 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-728f6eb6-dc6a-4edb-89be-fd76714e565e tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b7d1f201-7e10-4b37-83dd-b27acafd27ee" returned: 0 in 0.353s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-728f6eb6-dc6a-4edb-89be-fd76714e565e tempest-VolumesGetTest-280735193 None] Lock "cinder-quobyte-b7d1f201-7e10-4b37-83dd-b27acafd27ee" released by "delete_volume" :: held 1.018s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-728f6eb6-dc6a-4edb-89be-fd76714e565e tempest-VolumesGetTest-280735193 None] Created reservations ['ff283fa6-b2a0-471d-9bbb-149de012a44d', '2b0e27a1-3501-49ac-bc90-389a42a74f9e', 'ed92229c-50b4-4a89-bb93-8892d62e7d77', '79911934-4f85-43e8-af2c-e100614117d8'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-728f6eb6-dc6a-4edb-89be-fd76714e565e tempest-VolumesGetTest-280735193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-728f6eb6-dc6a-4edb-89be-fd76714e565e tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-728f6eb6-dc6a-4edb-89be-fd76714e565e tempest-VolumesGetTest-280735193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-728f6eb6-dc6a-4edb-89be-fd76714e565e tempest-VolumesGetTest-280735193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-728f6eb6-dc6a-4edb-89be-fd76714e565e tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-728f6eb6-dc6a-4edb-89be-fd76714e565e tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:17 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:10:17 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:17 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f393d507-c01e-4301-9e45-30759269421c 1073741824" returned: 0 in 0.714s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f393d507-c01e-4301-9e45-30759269421c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:17 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f393d507-c01e-4301-9e45-30759269421c Sep 06 08:10:17 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:18 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-728f6eb6-dc6a-4edb-89be-fd76714e565e tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.323s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:18 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-728f6eb6-dc6a-4edb-89be-fd76714e565e tempest-VolumesGetTest-280735193 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:10:18 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-728f6eb6-dc6a-4edb-89be-fd76714e565e tempest-VolumesGetTest-280735193 None] Deleted volume successfully. Sep 06 08:10:18 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-728f6eb6-dc6a-4edb-89be-fd76714e565e tempest-VolumesGetTest-280735193 None] Lock "cinder-b7d1f201-7e10-4b37-83dd-b27acafd27ee-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:10:18 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f393d507-c01e-4301-9e45-30759269421c" returned: 0 in 0.318s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:18 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:10:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be82a522-9cbc-4b98-9e83-4584e0b21fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f393d507-c01e-4301-9e45-30759269421c', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (368b28ba-9b6a-43e4-af6c-2b4fafb836bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:18 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Volume volume-f393d507-c01e-4301-9e45-30759269421c (f393d507-c01e-4301-9e45-30759269421c): created successfully Sep 06 08:10:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (368b28ba-9b6a-43e4-af6c-2b4fafb836bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Flow 'volume_create_manager' (f060c911-df19-4a87-90f9-19fbe614f33e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:10:18 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-9f4386df-11c7-4a94-a1d4-f1546472961a tempest-AttachVolumeTestJSON-589724430 None] Created volume successfully. Sep 06 08:10:19 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:10:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Flow 'volume_create_manager' (bbd2a129-2cb5-4190-b1e6-09c1665e45c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:10:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4af3e9-07a7-48f1-8a5b-62a8c083cdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4af3e9-07a7-48f1-8a5b-62a8c083cdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1042505619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1abe211-3a6c-4b44-8b16-a5ca718070ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a47a9504e64f8e84eefdbd2b49e415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:10:19Z,use_quota=True,user_id='24876789eae14ecca338ffff08d91140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf6b30a-f22e-4559-a3c2-2f7b9bb8ea5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf6b30a-f22e-4559-a3c2-2f7b9bb8ea5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0999d798-02f2-43b3-a72c-70a23cdf96af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0999d798-02f2-43b3-a72c-70a23cdf96af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1abe211-3a6c-4b44-8b16-a5ca718070ad', 'volume_name': 'volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8315cd59-915b-4656-9ab3-f88cf5b67021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8315cd59-915b-4656-9ab3-f88cf5b67021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd07791-c5e7-440d-bb80-af60a843a1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:19 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Volume b1abe211-3a6c-4b44-8b16-a5ca718070ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad', 'volume_size': 1} Sep 06 08:10:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1042505619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1abe211-3a6c-4b44-8b16-a5ca718070ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a47a9504e64f8e84eefdbd2b49e415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:10:19Z,use_quota=True,user_id='24876789eae14ecca338ffff08d91140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:10:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Creating volume b1abe211-3a6c-4b44-8b16-a5ca718070ad {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:10:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:10:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:10:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:10:19 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:10:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:19 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad 1073741824 Sep 06 08:10:19 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:20 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad 1073741824" returned: 0 in 0.643s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:20 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad Sep 06 08:10:20 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-f91c17c5-3164-40b2-a99d-a308a3180037 req-62b0794b-1f10-4cfb-8f39-6d82ea5e3df0 tempest-AttachVolumeTestJSON-589724430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:20 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad" returned: 0 in 0.325s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:10:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-f91c17c5-3164-40b2-a99d-a308a3180037 req-62b0794b-1f10-4cfb-8f39-6d82ea5e3df0 tempest-AttachVolumeTestJSON-589724430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.059s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd07791-c5e7-440d-bb80-af60a843a1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca829d0b-f1e8-4271-a335-a33329b2bf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-f91c17c5-3164-40b2-a99d-a308a3180037 req-62b0794b-1f10-4cfb-8f39-6d82ea5e3df0 tempest-AttachVolumeTestJSON-589724430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:20 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Volume volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad (b1abe211-3a6c-4b44-8b16-a5ca718070ad): created successfully Sep 06 08:10:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca829d0b-f1e8-4271-a335-a33329b2bf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Flow 'volume_create_manager' (bbd2a129-2cb5-4190-b1e6-09c1665e45c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:10:20 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e7582b2a-cd9f-4193-9b2b-a941fdcd1103 tempest-VolumesGetTest-280735193 None] Created volume successfully. Sep 06 08:10:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-f91c17c5-3164-40b2-a99d-a308a3180037 req-62b0794b-1f10-4cfb-8f39-6d82ea5e3df0 tempest-AttachVolumeTestJSON-589724430 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0', 'name': 'volume-f393d507-c01e-4301-9e45-30759269421c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93125116-ef2d-47fa-bf7b-a498e6cf0ad5', 'enforce_multipath': True} {{(pid=87307) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 08:10:20 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-f91c17c5-3164-40b2-a99d-a308a3180037 req-62b0794b-1f10-4cfb-8f39-6d82ea5e3df0 tempest-AttachVolumeTestJSON-589724430 None] attachment_update completed successfully. Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Flow 'volume_create_manager' (9bddf245-5289-40ff-9363-2a4a1b3ee127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b93c72-6c52-4264-9bed-fbaa1046eeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b93c72-6c52-4264-9bed-fbaa1046eeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-232075790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec097093-111b-43cf-a782-bef47d4f824c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2323c8022ab5440a822cfce78d626d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:10:22Z,use_quota=True,user_id='9f7add4683b542df9f5c84e73518e261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286df86f-f63b-425e-b449-bbba29699aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286df86f-f63b-425e-b449-bbba29699aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86de2c71-bb23-4dbe-8363-c6ae9b5592e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.image.glance [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Creating Keystone auth plugin from conf {{(pid=87307) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Flow 'volume_create_manager' (657fc8b8-4a33-40e0-a197-8be2acff6ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68df93e1-5b66-417f-9396-bb1bcb607742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68df93e1-5b66-417f-9396-bb1bcb607742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1137932996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a7161c2-9f94-4fde-a083-36431589df27,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='79a47a9504e64f8e84eefdbd2b49e415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b1abe211-3a6c-4b44-8b16-a5ca718070ad,status='creating',terminated_at=None,updated_at=2026-09-06T06:10:22Z,use_quota=True,user_id='24876789eae14ecca338ffff08d91140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77414a05-16d4-4f2d-b09c-214e730ca7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77414a05-16d4-4f2d-b09c-214e730ca7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1308ec-0246-4c4e-b4b3-fc4c36978dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1308ec-0246-4c4e-b4b3-fc4c36978dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9a7161c2-9f94-4fde-a083-36431589df27', 'volume_name': 'volume-9a7161c2-9f94-4fde-a083-36431589df27', 'volume_size': 1, 'source_volid': 'b1abe211-3a6c-4b44-8b16-a5ca718070ad', 'source_volstatus': 'available'}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5ed244-0650-43ed-b643-045b72e34af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5ed244-0650-43ed-b643-045b72e34af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c27a9c-8d35-4be6-98e3-edb43589d3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:22 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Volume 9a7161c2-9f94-4fde-a083-36431589df27: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9a7161c2-9f94-4fde-a083-36431589df27', 'volume_size': 1, 'source_volid': 'b1abe211-3a6c-4b44-8b16-a5ca718070ad', 'source_volstatus': 'available'} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:22 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Cloning volume b1abe211-3a6c-4b44-8b16-a5ca718070ad to volume 9a7161c2-9f94-4fde-a083-36431589df27 Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Creating offline snapshot bc26566e-dcab-4b8f-b7c0-6ec5efca9232 of volume b1abe211-3a6c-4b44-8b16-a5ca718070ad {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bd0545-ecb1-4cb2-817f-9600d0ea7feb]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:22 devstack sudo[96626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad Sep 06 08:10:22 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86de2c71-bb23-4dbe-8363-c6ae9b5592e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ec097093-111b-43cf-a782-bef47d4f824c', 'volume_name': 'volume-ec097093-111b-43cf-a782-bef47d4f824c', 'volume_size': 1, 'image_id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1531709cfd9f41a0b45e9cae3f8241b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'created_at': datetime.datetime(2026, 9, 6, 5, 57, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 5, 57, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd662984-2113-4cb9-beed-08123f932327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd662984-2113-4cb9-beed-08123f932327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2357e68f-ab89-4f2e-a8a3-f11e59f4feba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:22 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Volume ec097093-111b-43cf-a782-bef47d4f824c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ec097093-111b-43cf-a782-bef47d4f824c', 'volume_size': 1, 'image_id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1531709cfd9f41a0b45e9cae3f8241b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'created_at': datetime.datetime(2026, 9, 6, 5, 57, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 5, 57, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 06 08:10:22 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Trying to clone ec097093-111b-43cf-a782-bef47d4f824c from image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}]). {{(pid=87307) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 08:10:23 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad" returned: 0 in 0.654s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.bc26566e-dcab-4b8f-b7c0-6ec5efca9232 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:23 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.bc26566e-dcab-4b8f-b7c0-6ec5efca9232 1G Sep 06 08:10:23 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:23 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_3u9zmndndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 08:10:23 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Image download 20.69 MB at 20.69 MB/s Sep 06 08:10:23 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[60613bb1-09b2-40a2-85c7-6c6144a2455d]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:10:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_3u9zmndndevstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:23 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_3u9zmndndevstack@QuobyteHD Sep 06 08:10:23 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:23 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.bc26566e-dcab-4b8f-b7c0-6ec5efca9232 1G" returned: 0 in 0.502s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.bc26566e-dcab-4b8f-b7c0-6ec5efca9232 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:23 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.bc26566e-dcab-4b8f-b7c0-6ec5efca9232 Sep 06 08:10:23 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:23 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_3u9zmndndevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:23 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Temporary image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 is fetched for user 9f7add4683b542df9f5c84e73518e261. {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 08:10:23 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dabf96-6d63-4b15-adc7-1258a94dd326]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:10:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_3u9zmndndevstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:23 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.bc26566e-dcab-4b8f-b7c0-6ec5efca9232" returned: 0 in 0.337s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:23 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.bc26566e-dcab-4b8f-b7c0-6ec5efca9232 is being set with open permissions: ugo+rw Sep 06 08:10:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.bc26566e-dcab-4b8f-b7c0-6ec5efca9232 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:23 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.bc26566e-dcab-4b8f-b7c0-6ec5efca9232 Sep 06 08:10:23 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:23 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_3u9zmndndevstack@QuobyteHD Sep 06 08:10:23 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:24 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.bc26566e-dcab-4b8f-b7c0-6ec5efca9232" returned: 0 in 0.317s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:24 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_3u9zmndndevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:10:24 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.info Sep 06 08:10:24 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Flow 'volume_create_manager' (b522e57e-12b7-44b9-8d83-7c95124fad81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ea5c08-02cc-4955-9d28-08e321c8f8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ea5c08-02cc-4955-9d28-08e321c8f8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-60485172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea1bff2-6037-471c-9af9-f175acdd2b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='375a90bfe07c45198a2af8b15070f547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:10:24Z,use_quota=True,user_id='2f46826859c442b1968e95ce52156fe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018c80ee-ff7e-4afd-8767-ea03c4fcaa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018c80ee-ff7e-4afd-8767-ea03c4fcaa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db1c230-9d29-4bd5-8670-197374b520ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db1c230-9d29-4bd5-8670-197374b520ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ea1bff2-6037-471c-9af9-f175acdd2b08', 'volume_name': 'volume-3ea1bff2-6037-471c-9af9-f175acdd2b08', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e2fd4b9-731a-4d31-bc69-02c10a595872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e2fd4b9-731a-4d31-bc69-02c10a595872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (011d473c-df8f-4695-8e56-dd9c3ed9b557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:24 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Volume 3ea1bff2-6037-471c-9af9-f175acdd2b08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ea1bff2-6037-471c-9af9-f175acdd2b08', 'volume_size': 1} Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:24 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.info" returned: 0 in 0.270s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:24 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.info is being set with open permissions: ugo+rw Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:24 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.info Sep 06 08:10:24 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:24 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.info" returned: 0 in 0.260s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Acquiring lock "cinder-quobyte-9a7161c2-9f94-4fde-a083-36431589df27" by "_copy_volume_from_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Lock "cinder-quobyte-9a7161c2-9f94-4fde-a083-36431589df27" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] snapshot: bc26566e-dcab-4b8f-b7c0-6ec5efca9232, volume: 9a7161c2-9f94-4fde-a083-36431589df27, {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5587986c-4c47-478b-a676-666f847e4168]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:10:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.bc26566e-dcab-4b8f-b7c0-6ec5efca9232 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:24 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.bc26566e-dcab-4b8f-b7c0-6ec5efca9232 Sep 06 08:10:24 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:25 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.bc26566e-dcab-4b8f-b7c0-6ec5efca9232" returned: 0 in 0.451s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:25 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:10:25 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69e0c27-6b22-4535-a360-252593e1c923]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:10:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:25 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad Sep 06 08:10:25 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:25 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad" returned: 0 in 0.485s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:25 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] will copy from snapshot at /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 06 08:10:25 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Creating direct copy from snapshot {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 06 08:10:25 devstack cinder-volume[87307]: DEBUG cinder.utils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Path /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a7161c2-9f94-4fde-a083-36431589df27 not found in is_blk_device check {{(pid=87307) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 06 08:10:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a7161c2-9f94-4fde-a083-36431589df27 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:25 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a7161c2-9f94-4fde-a083-36431589df27 Sep 06 08:10:25 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:32 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a7161c2-9f94-4fde-a083-36431589df27" returned: 0 in 6.694s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:32 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Image conversion details: src /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad, size 1024.00 MB, duration 6.70 sec, destination /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a7161c2-9f94-4fde-a083-36431589df27 {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:10:32 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Converted 1024.00 MB image at 152.93 MB/s Sep 06 08:10:32 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a7161c2-9f94-4fde-a083-36431589df27 is being set with open permissions: ugo+rw Sep 06 08:10:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a7161c2-9f94-4fde-a083-36431589df27 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:32 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a7161c2-9f94-4fde-a083-36431589df27 Sep 06 08:10:32 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:32 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a7161c2-9f94-4fde-a083-36431589df27" returned: 0 in 0.244s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:32 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Lock "cinder-quobyte-9a7161c2-9f94-4fde-a083-36431589df27" released by "_copy_volume_from_snapshot" :: held 7.968s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:10:32 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:UPDATE=165,cinder:SELECT=133,cinder:DELETE=13,cinder:INSERT=45 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:10:32 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Acquiring lock "cinder-quobyte-bc26566e-dcab-4b8f-b7c0-6ec5efca9232" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:10:32 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Lock "cinder-quobyte-bc26566e-dcab-4b8f-b7c0-6ec5efca9232" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:10:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Deleting offline snapshot bc26566e-dcab-4b8f-b7c0-6ec5efca9232 of volume b1abe211-3a6c-4b44-8b16-a5ca718070ad {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:10:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] snapshot_file for this snap is: volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.bc26566e-dcab-4b8f-b7c0-6ec5efca9232 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:10:32 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[26be0b6a-6865-4318-a60b-d7fe594771dd]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:10:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.bc26566e-dcab-4b8f-b7c0-6ec5efca9232 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:32 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.bc26566e-dcab-4b8f-b7c0-6ec5efca9232 Sep 06 08:10:32 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:33 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.bc26566e-dcab-4b8f-b7c0-6ec5efca9232" returned: 0 in 0.377s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:10:33 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd201f9-220f-4b1e-b066-8b38b5733d37]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:10:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:33 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad Sep 06 08:10:33 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:33 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad" returned: 0 in 0.529s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.bc26566e-dcab-4b8f-b7c0-6ec5efca9232 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:33 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.bc26566e-dcab-4b8f-b7c0-6ec5efca9232 Sep 06 08:10:33 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:34 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.bc26566e-dcab-4b8f-b7c0-6ec5efca9232" returned: 0 in 0.314s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.bc26566e-dcab-4b8f-b7c0-6ec5efca9232 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:34 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.bc26566e-dcab-4b8f-b7c0-6ec5efca9232 Sep 06 08:10:34 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:34 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=139,cinder:INSERT=40,cinder:UPDATE=163,cinder:DELETE=10 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:10:34 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad.bc26566e-dcab-4b8f-b7c0-6ec5efca9232" returned: 0 in 0.259s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:34 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Lock "cinder-quobyte-bc26566e-dcab-4b8f-b7c0-6ec5efca9232" released by "_delete_snapshot" :: held 1.571s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:10:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.122s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.173s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-232075790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec097093-111b-43cf-a782-bef47d4f824c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2323c8022ab5440a822cfce78d626d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:10:22Z,use_quota=True,user_id='9f7add4683b542df9f5c84e73518e261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:10:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Creating volume ec097093-111b-43cf-a782-bef47d4f824c {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:10:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:10:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:10:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:10:34 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:10:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ec097093-111b-43cf-a782-bef47d4f824c 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:34 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c27a9c-8d35-4be6-98e3-edb43589d3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a7161c2-9f94-4fde-a083-36431589df27', 'volume_size': 1, 'source_volid': 'b1abe211-3a6c-4b44-8b16-a5ca718070ad', 'source_volstatus': 'available'}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:34 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b739ba-dbae-48da-97cb-c062a20d48e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:34 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ec097093-111b-43cf-a782-bef47d4f824c 1073741824 Sep 06 08:10:34 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:34 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Volume volume-9a7161c2-9f94-4fde-a083-36431589df27 (9a7161c2-9f94-4fde-a083-36431589df27): created successfully Sep 06 08:10:34 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b739ba-dbae-48da-97cb-c062a20d48e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:34 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Flow 'volume_create_manager' (657fc8b8-4a33-40e0-a197-8be2acff6ee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:10:34 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-a049c7ac-5e5a-4888-aa33-ec56bda64a11 tempest-VolumesGetTest-280735193 None] Created volume successfully. Sep 06 08:10:34 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ec097093-111b-43cf-a782-bef47d4f824c 1073741824" returned: 0 in 0.426s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ec097093-111b-43cf-a782-bef47d4f824c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:34 devstack sudo[97223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ec097093-111b-43cf-a782-bef47d4f824c Sep 06 08:10:34 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:35 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ec097093-111b-43cf-a782-bef47d4f824c" returned: 0 in 0.246s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:10:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.812s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-60485172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea1bff2-6037-471c-9af9-f175acdd2b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='375a90bfe07c45198a2af8b15070f547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:10:24Z,use_quota=True,user_id='2f46826859c442b1968e95ce52156fe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:10:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Creating volume 3ea1bff2-6037-471c-9af9-f175acdd2b08 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:10:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:10:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:10:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:10:35 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:10:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:35 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08 1073741824 Sep 06 08:10:35 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:35 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Attempting download of 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}])) to volume ec097093-111b-43cf-a782-bef47d4f824c. {{(pid=87307) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 08:10:35 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3f3aaa-7518-46c9-b1a7-0267cd43ce20]: (4, 'raw') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:10:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_qrmvivqd {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:35 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_qrmvivqd Sep 06 08:10:35 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:35 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08 1073741824" returned: 0 in 0.471s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:35 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_qrmvivqd" returned: 0 in 0.387s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_qrmvivqd {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:35 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08 Sep 06 08:10:35 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:35 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_qrmvivqd Sep 06 08:10:35 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:36 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08" returned: 0 in 0.313s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (011d473c-df8f-4695-8e56-dd9c3ed9b557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ea1bff2-6037-471c-9af9-f175acdd2b08', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58516b3c-2f85-4cdd-ba6a-0a280b1a780a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:36 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Volume volume-3ea1bff2-6037-471c-9af9-f175acdd2b08 (3ea1bff2-6037-471c-9af9-f175acdd2b08): created successfully Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58516b3c-2f85-4cdd-ba6a-0a280b1a780a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Flow 'volume_create_manager' (b522e57e-12b7-44b9-8d83-7c95124fad81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:10:36 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f0fa2251-3f63-4505-9e28-1466859714d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Created volume successfully. Sep 06 08:10:36 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_qrmvivqd" returned: 1 in 0.481s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_qrmvivqd' failed. Not Retrying. {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff632f3a-0464-4209-88a4-e69fb0df9e5f]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_3u9zmndndevstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:36 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_3u9zmndndevstack@QuobyteHD Sep 06 08:10:36 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Flow 'volume_create_manager' (d70ca9be-e553-43f7-8c29-a4ffdd9e4f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f192ed00-155b-44a4-af41-a278e14f62b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f192ed00-155b-44a4-af41-a278e14f62b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:10:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1988403259',display_name='tempest-VolumesGetTest-Volume-448460149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d67762-d8ef-4c4c-800e-8056ecc9dedf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a47a9504e64f8e84eefdbd2b49e415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:10:36Z,use_quota=True,user_id='24876789eae14ecca338ffff08d91140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b90c42-4b77-4028-9288-cf08e04883ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b90c42-4b77-4028-9288-cf08e04883ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cebfa22-da6d-449a-a16f-664a7fa8a573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cebfa22-da6d-449a-a16f-664a7fa8a573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45d67762-d8ef-4c4c-800e-8056ecc9dedf', 'volume_name': 'volume-45d67762-d8ef-4c4c-800e-8056ecc9dedf', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:36 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5985dfc-8dec-4581-bec0-afd22f23a0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5985dfc-8dec-4581-bec0-afd22f23a0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a297105b-cda7-4677-82bc-0b0c27427724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:36 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Volume 45d67762-d8ef-4c4c-800e-8056ecc9dedf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45d67762-d8ef-4c4c-800e-8056ecc9dedf', 'volume_size': 1} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:10:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1988403259',display_name='tempest-VolumesGetTest-Volume-448460149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d67762-d8ef-4c4c-800e-8056ecc9dedf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a47a9504e64f8e84eefdbd2b49e415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:10:36Z,use_quota=True,user_id='24876789eae14ecca338ffff08d91140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Creating volume 45d67762-d8ef-4c4c-800e-8056ecc9dedf {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:10:36 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-45d67762-d8ef-4c4c-800e-8056ecc9dedf 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_3u9zmndndevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 was qcow2, converting to qcow2 {{(pid=87307) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 08:10:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_3u9zmndndevstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ec097093-111b-43cf-a782-bef47d4f824c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:36 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-45d67762-d8ef-4c4c-800e-8056ecc9dedf 1073741824 Sep 06 08:10:36 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:36 devstack sudo[97250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_3u9zmndndevstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ec097093-111b-43cf-a782-bef47d4f824c Sep 06 08:10:36 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-49c1b3fa-271e-4878-be1f-adbe8d83d859 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:37 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-45d67762-d8ef-4c4c-800e-8056ecc9dedf 1073741824" returned: 0 in 0.547s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-45d67762-d8ef-4c4c-800e-8056ecc9dedf {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:37 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-45d67762-d8ef-4c4c-800e-8056ecc9dedf Sep 06 08:10:37 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:37 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-45d67762-d8ef-4c4c-800e-8056ecc9dedf" returned: 0 in 0.283s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:10:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-49c1b3fa-271e-4878-be1f-adbe8d83d859 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.495s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a297105b-cda7-4677-82bc-0b0c27427724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d67762-d8ef-4c4c-800e-8056ecc9dedf', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e0510b7-f39d-4dda-8c02-3f5290fe8b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-49c1b3fa-271e-4878-be1f-adbe8d83d859 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Creating offline snapshot f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c of volume 3ea1bff2-6037-471c-9af9-f175acdd2b08 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:10:37 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Volume volume-45d67762-d8ef-4c4c-800e-8056ecc9dedf (45d67762-d8ef-4c4c-800e-8056ecc9dedf): created successfully Sep 06 08:10:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e0510b7-f39d-4dda-8c02-3f5290fe8b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Flow 'volume_create_manager' (d70ca9be-e553-43f7-8c29-a4ffdd9e4f54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:10:37 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f0e668-6b63-424b-9acb-4365e30e8c32]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:10:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-49c1b3fa-271e-4878-be1f-adbe8d83d859 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:37 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-bf53d440-addd-46ea-be61-319fc233a593 tempest-VolumesGetTest-280735193 None] Created volume successfully. Sep 06 08:10:37 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08 Sep 06 08:10:37 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:38 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-49c1b3fa-271e-4878-be1f-adbe8d83d859 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08" returned: 0 in 0.433s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-49c1b3fa-271e-4878-be1f-adbe8d83d859 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:38 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c 1G Sep 06 08:10:38 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:38 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_3u9zmndndevstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ec097093-111b-43cf-a782-bef47d4f824c" returned: 0 in 1.816s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:38 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_3u9zmndndevstack@QuobyteHD, size 112.00 MB, duration 1.82 sec, destination /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ec097093-111b-43cf-a782-bef47d4f824c {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:10:38 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Converted 112.00 MB image at 61.61 MB/s Sep 06 08:10:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ec097093-111b-43cf-a782-bef47d4f824c 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:38 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ec097093-111b-43cf-a782-bef47d4f824c 1G Sep 06 08:10:38 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:38 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-49c1b3fa-271e-4878-be1f-adbe8d83d859 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c 1G" returned: 0 in 0.517s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-49c1b3fa-271e-4878-be1f-adbe8d83d859 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ea1bff2-6037-471c-9af9-f175acdd2b08 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:38 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ea1bff2-6037-471c-9af9-f175acdd2b08 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c Sep 06 08:10:38 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1bd9365f-a336-491d-9af8-26dd7d02fbe6 tempest-VolumesGetTest-280735193 None] Acquiring lock "cinder-45d67762-d8ef-4c4c-800e-8056ecc9dedf-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:10:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1bd9365f-a336-491d-9af8-26dd7d02fbe6 tempest-VolumesGetTest-280735193 None] Lock "cinder-45d67762-d8ef-4c4c-800e-8056ecc9dedf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:10:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1bd9365f-a336-491d-9af8-26dd7d02fbe6 tempest-VolumesGetTest-280735193 None] Acquiring lock "cinder-quobyte-45d67762-d8ef-4c4c-800e-8056ecc9dedf" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:10:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1bd9365f-a336-491d-9af8-26dd7d02fbe6 tempest-VolumesGetTest-280735193 None] Lock "cinder-quobyte-45d67762-d8ef-4c4c-800e-8056ecc9dedf" acquired by "delete_volume" :: waited 0.023s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:10:38 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[137b3bda-d331-4681-b1bf-41e3d49dc878]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:10:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1bd9365f-a336-491d-9af8-26dd7d02fbe6 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-45d67762-d8ef-4c4c-800e-8056ecc9dedf {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:38 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-49c1b3fa-271e-4878-be1f-adbe8d83d859 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ea1bff2-6037-471c-9af9-f175acdd2b08 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c" returned: 0 in 0.425s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:38 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-49c1b3fa-271e-4878-be1f-adbe8d83d859 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c is being set with open permissions: ugo+rw Sep 06 08:10:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-49c1b3fa-271e-4878-be1f-adbe8d83d859 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:38 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ec097093-111b-43cf-a782-bef47d4f824c 1G" returned: 0 in 0.509s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:38 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Downloaded image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}])) to volume ec097093-111b-43cf-a782-bef47d4f824c successfully. {{(pid=87307) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 08:10:38 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Temporary image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 for user 9f7add4683b542df9f5c84e73518e261 is deleted. {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 08:10:38 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Marking volume ec097093-111b-43cf-a782-bef47d4f824c as bootable. {{(pid=87307) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 08:10:39 devstack sudo[97290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c Sep 06 08:10:39 devstack sudo[97290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:39 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Copying metadata from image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 to ec097093-111b-43cf-a782-bef47d4f824c. {{(pid=87307) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 08:10:39 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Creating volume glance metadata for volume ec097093-111b-43cf-a782-bef47d4f824c backed by image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87307) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 08:10:39 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-45d67762-d8ef-4c4c-800e-8056ecc9dedf Sep 06 08:10:39 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2357e68f-ab89-4f2e-a8a3-f11e59f4feba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec097093-111b-43cf-a782-bef47d4f824c', 'volume_size': 1, 'image_id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1531709cfd9f41a0b45e9cae3f8241b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'created_at': datetime.datetime(2026, 9, 6, 5, 57, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 5, 57, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b39d36-a25e-40aa-a901-ddef0226e352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:39 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Volume volume-ec097093-111b-43cf-a782-bef47d4f824c (ec097093-111b-43cf-a782-bef47d4f824c): created successfully Sep 06 08:10:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b39d36-a25e-40aa-a901-ddef0226e352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Flow 'volume_create_manager' (9bddf245-5289-40ff-9363-2a4a1b3ee127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:10:39 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-130048fd-d81b-4b27-bc62-b8417be67b00 tempest-TestShelveInstance-508546574 None] Created volume successfully. Sep 06 08:10:39 devstack sudo[97290]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-49c1b3fa-271e-4878-be1f-adbe8d83d859 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c" returned: 0 in 0.323s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-49c1b3fa-271e-4878-be1f-adbe8d83d859 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:39 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1bd9365f-a336-491d-9af8-26dd7d02fbe6 tempest-VolumesGetTest-280735193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-45d67762-d8ef-4c4c-800e-8056ecc9dedf" returned: 0 in 0.446s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1bd9365f-a336-491d-9af8-26dd7d02fbe6 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-45d67762-d8ef-4c4c-800e-8056ecc9dedf {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:39 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.info Sep 06 08:10:39 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:39 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-45d67762-d8ef-4c4c-800e-8056ecc9dedf Sep 06 08:10:39 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:39 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1bd9365f-a336-491d-9af8-26dd7d02fbe6 tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-45d67762-d8ef-4c4c-800e-8056ecc9dedf" returned: 0 in 0.239s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:39 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-49c1b3fa-271e-4878-be1f-adbe8d83d859 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.info" returned: 0 in 0.285s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:39 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-49c1b3fa-271e-4878-be1f-adbe8d83d859 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.info is being set with open permissions: ugo+rw Sep 06 08:10:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-49c1b3fa-271e-4878-be1f-adbe8d83d859 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:39 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1bd9365f-a336-491d-9af8-26dd7d02fbe6 tempest-VolumesGetTest-280735193 None] Lock "cinder-quobyte-45d67762-d8ef-4c4c-800e-8056ecc9dedf" released by "delete_volume" :: held 0.753s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:10:39 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.info Sep 06 08:10:39 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:39 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-1bd9365f-a336-491d-9af8-26dd7d02fbe6 tempest-VolumesGetTest-280735193 None] Created reservations ['5534b279-373e-4763-bf8b-d3463ed0de67', '5e39710c-a57c-441a-8c23-085b393c8be8', '9c6c0101-f1fd-4a2b-8c96-50a9a218d882', '6f47ed64-0c6a-4f16-adea-3a0a995c75a0'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:10:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1bd9365f-a336-491d-9af8-26dd7d02fbe6 tempest-VolumesGetTest-280735193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1bd9365f-a336-491d-9af8-26dd7d02fbe6 tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1bd9365f-a336-491d-9af8-26dd7d02fbe6 tempest-VolumesGetTest-280735193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:10:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1bd9365f-a336-491d-9af8-26dd7d02fbe6 tempest-VolumesGetTest-280735193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:10:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1bd9365f-a336-491d-9af8-26dd7d02fbe6 tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1bd9365f-a336-491d-9af8-26dd7d02fbe6 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:39 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:10:39 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:39 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-49c1b3fa-271e-4878-be1f-adbe8d83d859 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.info" returned: 0 in 0.300s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-49c1b3fa-271e-4878-be1f-adbe8d83d859 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.466s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:40 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-49c1b3fa-271e-4878-be1f-adbe8d83d859 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Create snapshot completed successfully Sep 06 08:10:40 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-09ac0d62-9239-4978-8f3c-fc7b17682c94 tempest-VolumesGetTest-280735193 None] Acquiring lock "cinder-9a7161c2-9f94-4fde-a083-36431589df27-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:10:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1bd9365f-a336-491d-9af8-26dd7d02fbe6 tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.371s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:40 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-1bd9365f-a336-491d-9af8-26dd7d02fbe6 tempest-VolumesGetTest-280735193 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:10:40 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-1bd9365f-a336-491d-9af8-26dd7d02fbe6 tempest-VolumesGetTest-280735193 None] Deleted volume successfully. Sep 06 08:10:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-09ac0d62-9239-4978-8f3c-fc7b17682c94 tempest-VolumesGetTest-280735193 None] Lock "cinder-9a7161c2-9f94-4fde-a083-36431589df27-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:10:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1bd9365f-a336-491d-9af8-26dd7d02fbe6 tempest-VolumesGetTest-280735193 None] Lock "cinder-45d67762-d8ef-4c4c-800e-8056ecc9dedf-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:10:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-09ac0d62-9239-4978-8f3c-fc7b17682c94 tempest-VolumesGetTest-280735193 None] Acquiring lock "cinder-quobyte-9a7161c2-9f94-4fde-a083-36431589df27" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:10:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-09ac0d62-9239-4978-8f3c-fc7b17682c94 tempest-VolumesGetTest-280735193 None] Lock "cinder-quobyte-9a7161c2-9f94-4fde-a083-36431589df27" acquired by "delete_volume" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:10:40 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67b9eec-0bf6-463f-b1cc-ecf79f6294e9]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:10:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-09ac0d62-9239-4978-8f3c-fc7b17682c94 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a7161c2-9f94-4fde-a083-36431589df27 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:40 devstack sudo[97310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a7161c2-9f94-4fde-a083-36431589df27 Sep 06 08:10:40 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:40 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-09ac0d62-9239-4978-8f3c-fc7b17682c94 tempest-VolumesGetTest-280735193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a7161c2-9f94-4fde-a083-36431589df27" returned: 0 in 0.565s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-09ac0d62-9239-4978-8f3c-fc7b17682c94 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a7161c2-9f94-4fde-a083-36431589df27 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:40 devstack sudo[97316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a7161c2-9f94-4fde-a083-36431589df27 Sep 06 08:10:40 devstack sudo[97316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-648aee93-9463-4dc9-89ab-aa92b0abd268 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Acquiring lock "cinder-f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:10:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-648aee93-9463-4dc9-89ab-aa92b0abd268 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Lock "cinder-f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:10:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-648aee93-9463-4dc9-89ab-aa92b0abd268 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Acquiring lock "cinder-quobyte-3ea1bff2-6037-471c-9af9-f175acdd2b08" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:10:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-648aee93-9463-4dc9-89ab-aa92b0abd268 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Lock "cinder-quobyte-3ea1bff2-6037-471c-9af9-f175acdd2b08" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:10:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-648aee93-9463-4dc9-89ab-aa92b0abd268 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Acquiring lock "cinder-quobyte-f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-648aee93-9463-4dc9-89ab-aa92b0abd268 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Lock "cinder-quobyte-f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-648aee93-9463-4dc9-89ab-aa92b0abd268 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Deleting offline snapshot f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c of volume 3ea1bff2-6037-471c-9af9-f175acdd2b08 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-648aee93-9463-4dc9-89ab-aa92b0abd268 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] snapshot_file for this snap is: volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee3fe72-c3f3-4fc7-bfd2-1dbe5cde01d4]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-648aee93-9463-4dc9-89ab-aa92b0abd268 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:41 devstack sudo[97316]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-09ac0d62-9239-4978-8f3c-fc7b17682c94 tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a7161c2-9f94-4fde-a083-36431589df27" returned: 0 in 0.318s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-09ac0d62-9239-4978-8f3c-fc7b17682c94 tempest-VolumesGetTest-280735193 None] Lock "cinder-quobyte-9a7161c2-9f94-4fde-a083-36431589df27" released by "delete_volume" :: held 0.979s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:10:41 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c Sep 06 08:10:41 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-09ac0d62-9239-4978-8f3c-fc7b17682c94 tempest-VolumesGetTest-280735193 None] Created reservations ['d5c2af55-995b-49bd-81b8-54a67ba5aed7', '1d5c1903-f734-41c6-83d2-fa23871e19cb', '4a992d8d-3022-4736-bc4f-7129f7d448e6', 'edc4de0d-7976-4e37-930c-2de8310530d0'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-09ac0d62-9239-4978-8f3c-fc7b17682c94 tempest-VolumesGetTest-280735193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-09ac0d62-9239-4978-8f3c-fc7b17682c94 tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-09ac0d62-9239-4978-8f3c-fc7b17682c94 tempest-VolumesGetTest-280735193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-09ac0d62-9239-4978-8f3c-fc7b17682c94 tempest-VolumesGetTest-280735193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-09ac0d62-9239-4978-8f3c-fc7b17682c94 tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-09ac0d62-9239-4978-8f3c-fc7b17682c94 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:41 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:10:41 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b4b0577e-48c5-4074-890c-b28e1da49638 tempest-VolumesGetTest-280735193 None] Acquiring lock "cinder-b1abe211-3a6c-4b44-8b16-a5ca718070ad-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b4b0577e-48c5-4074-890c-b28e1da49638 tempest-VolumesGetTest-280735193 None] Lock "cinder-b1abe211-3a6c-4b44-8b16-a5ca718070ad-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:10:41 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-648aee93-9463-4dc9-89ab-aa92b0abd268 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c" returned: 0 in 0.676s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:41 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b4b0577e-48c5-4074-890c-b28e1da49638 tempest-VolumesGetTest-280735193 None] Acquiring lock "cinder-quobyte-b1abe211-3a6c-4b44-8b16-a5ca718070ad" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-648aee93-9463-4dc9-89ab-aa92b0abd268 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ea1bff2-6037-471c-9af9-f175acdd2b08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-09ac0d62-9239-4978-8f3c-fc7b17682c94 tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.413s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-09ac0d62-9239-4978-8f3c-fc7b17682c94 tempest-VolumesGetTest-280735193 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b464fc-de9a-4938-b2bb-96ecc1aa8647]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-648aee93-9463-4dc9-89ab-aa92b0abd268 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:41 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-09ac0d62-9239-4978-8f3c-fc7b17682c94 tempest-VolumesGetTest-280735193 None] Deleted volume successfully. Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b4b0577e-48c5-4074-890c-b28e1da49638 tempest-VolumesGetTest-280735193 None] Lock "cinder-quobyte-b1abe211-3a6c-4b44-8b16-a5ca718070ad" acquired by "delete_volume" :: waited 0.088s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-09ac0d62-9239-4978-8f3c-fc7b17682c94 tempest-VolumesGetTest-280735193 None] Lock "cinder-9a7161c2-9f94-4fde-a083-36431589df27-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f413de2d-116f-41c3-b903-caf060e4c2af]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:10:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b4b0577e-48c5-4074-890c-b28e1da49638 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:41 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08 Sep 06 08:10:41 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:42 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad Sep 06 08:10:42 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:42 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-648aee93-9463-4dc9-89ab-aa92b0abd268 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08" returned: 0 in 0.541s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-648aee93-9463-4dc9-89ab-aa92b0abd268 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:42 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c Sep 06 08:10:42 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:42 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b4b0577e-48c5-4074-890c-b28e1da49638 tempest-VolumesGetTest-280735193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad" returned: 0 in 0.530s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b4b0577e-48c5-4074-890c-b28e1da49638 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:42 devstack sudo[97351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad Sep 06 08:10:42 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:42 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b4b0577e-48c5-4074-890c-b28e1da49638 tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1abe211-3a6c-4b44-8b16-a5ca718070ad" returned: 0 in 0.369s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:42 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-648aee93-9463-4dc9-89ab-aa92b0abd268 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c" returned: 0 in 0.487s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-648aee93-9463-4dc9-89ab-aa92b0abd268 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:42 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b4b0577e-48c5-4074-890c-b28e1da49638 tempest-VolumesGetTest-280735193 None] Lock "cinder-quobyte-b1abe211-3a6c-4b44-8b16-a5ca718070ad" released by "delete_volume" :: held 1.019s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:10:42 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c Sep 06 08:10:42 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:42 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-b4b0577e-48c5-4074-890c-b28e1da49638 tempest-VolumesGetTest-280735193 None] Created reservations ['e4bf9d3b-a657-4af3-b425-cf4c5b07d22c', 'a7485c51-df2c-47de-8387-6b52f25434a8', '7c5dd356-61f6-4e8e-afd7-08e488b45af7', '30794ef7-6328-4936-bcde-79d76915282a'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:10:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b4b0577e-48c5-4074-890c-b28e1da49638 tempest-VolumesGetTest-280735193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b4b0577e-48c5-4074-890c-b28e1da49638 tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:43 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b4b0577e-48c5-4074-890c-b28e1da49638 tempest-VolumesGetTest-280735193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:10:43 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b4b0577e-48c5-4074-890c-b28e1da49638 tempest-VolumesGetTest-280735193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:10:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b4b0577e-48c5-4074-890c-b28e1da49638 tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b4b0577e-48c5-4074-890c-b28e1da49638 tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:43 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:10:43 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:43 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-648aee93-9463-4dc9-89ab-aa92b0abd268 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08.f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c" returned: 0 in 0.346s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-648aee93-9463-4dc9-89ab-aa92b0abd268 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Lock "cinder-quobyte-f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c" released by "_delete_snapshot" :: held 2.248s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:10:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-648aee93-9463-4dc9-89ab-aa92b0abd268 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Lock "cinder-quobyte-3ea1bff2-6037-471c-9af9-f175acdd2b08" released by "delete_snapshot" :: held 2.304s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:10:43 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-648aee93-9463-4dc9-89ab-aa92b0abd268 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Created reservations ['090bfa63-bba8-418f-a703-b3cd704b3e1c', '02c3bbe8-26aa-4921-b4f3-4c185437db5a', 'c5063784-4ea0-4946-9d8f-7a6a33138370', 'b712cd6e-4f4e-4d8b-a4dc-4c55ce71038f'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:10:43 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b4b0577e-48c5-4074-890c-b28e1da49638 tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.376s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:43 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-b4b0577e-48c5-4074-890c-b28e1da49638 tempest-VolumesGetTest-280735193 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:10:43 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-b4b0577e-48c5-4074-890c-b28e1da49638 tempest-VolumesGetTest-280735193 None] Deleted volume successfully. Sep 06 08:10:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b4b0577e-48c5-4074-890c-b28e1da49638 tempest-VolumesGetTest-280735193 None] Lock "cinder-b1abe211-3a6c-4b44-8b16-a5ca718070ad-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:10:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-79a7bacc-3cf3-4921-8d75-db638935d7b4 req-929cf67c-6fc5-4400-af40-bf1a2b5066a6 tempest-TestShelveInstance-508546574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-79a7bacc-3cf3-4921-8d75-db638935d7b4 req-929cf67c-6fc5-4400-af40-bf1a2b5066a6 tempest-TestShelveInstance-508546574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-79a7bacc-3cf3-4921-8d75-db638935d7b4 req-929cf67c-6fc5-4400-af40-bf1a2b5066a6 tempest-TestShelveInstance-508546574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:43 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-648aee93-9463-4dc9-89ab-aa92b0abd268 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Delete snapshot completed successfully. Sep 06 08:10:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-648aee93-9463-4dc9-89ab-aa92b0abd268 tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Lock "cinder-f2ce2d40-5f5b-4f8c-874e-2cd3ac386e7c-delete_snapshot" released by "delete_snapshot" :: held 2.626s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:10:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-79a7bacc-3cf3-4921-8d75-db638935d7b4 req-929cf67c-6fc5-4400-af40-bf1a2b5066a6 tempest-TestShelveInstance-508546574 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0', 'name': 'volume-ec097093-111b-43cf-a782-bef47d4f824c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84b41db8-b337-4cce-8c55-3b5999183ed2', 'enforce_multipath': True} {{(pid=87307) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 08:10:43 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-79a7bacc-3cf3-4921-8d75-db638935d7b4 req-929cf67c-6fc5-4400-af40-bf1a2b5066a6 tempest-TestShelveInstance-508546574 None] attachment_update completed successfully. Sep 06 08:10:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e1e01b1b-b104-4bd8-a21f-afbd8c6f0d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Acquiring lock "cinder-3ea1bff2-6037-471c-9af9-f175acdd2b08-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:10:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e1e01b1b-b104-4bd8-a21f-afbd8c6f0d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Lock "cinder-3ea1bff2-6037-471c-9af9-f175acdd2b08-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:10:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e1e01b1b-b104-4bd8-a21f-afbd8c6f0d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Acquiring lock "cinder-quobyte-3ea1bff2-6037-471c-9af9-f175acdd2b08" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:10:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e1e01b1b-b104-4bd8-a21f-afbd8c6f0d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Lock "cinder-quobyte-3ea1bff2-6037-471c-9af9-f175acdd2b08" acquired by "delete_volume" :: waited 0.016s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:10:44 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[156e6f85-3a0c-49aa-92e0-c0055978fd9e]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:10:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e1e01b1b-b104-4bd8-a21f-afbd8c6f0d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:44 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08 Sep 06 08:10:44 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:44 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:10:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Flow 'volume_create_manager' (8266b6ff-1874-4acd-9693-d10dd301723c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:10:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d3e01c-8a1a-49c7-bb06-c0aaa8c21d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d3e01c-8a1a-49c7-bb06-c0aaa8c21d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1590802755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d622ef-3b8c-4ec0-8445-24a5762d7934,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='79a47a9504e64f8e84eefdbd2b49e415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:10:45Z,use_quota=True,user_id='24876789eae14ecca338ffff08d91140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:44 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e55b08e-1799-4392-a02b-8b5e82b538c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e55b08e-1799-4392-a02b-8b5e82b538c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d749925f-b8d8-42e6-ad11-7e4f53dd24c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:44 devstack cinder-volume[87307]: DEBUG cinder.image.glance [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Creating Keystone auth plugin from conf {{(pid=87307) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 08:10:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e1e01b1b-b104-4bd8-a21f-afbd8c6f0d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08" returned: 0 in 0.514s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e1e01b1b-b104-4bd8-a21f-afbd8c6f0d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:44 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08 Sep 06 08:10:44 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d749925f-b8d8-42e6-ad11-7e4f53dd24c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '03d622ef-3b8c-4ec0-8445-24a5762d7934', 'volume_name': 'volume-03d622ef-3b8c-4ec0-8445-24a5762d7934', 'volume_size': 1, 'image_id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1531709cfd9f41a0b45e9cae3f8241b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'created_at': datetime.datetime(2026, 9, 6, 5, 57, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 5, 57, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90e1874-102a-4e02-a230-a965a04b4285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90e1874-102a-4e02-a230-a965a04b4285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:45 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c36ba8-1ba7-4980-802a-a9dab5a3d9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:45 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Volume 03d622ef-3b8c-4ec0-8445-24a5762d7934: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-03d622ef-3b8c-4ec0-8445-24a5762d7934', 'volume_size': 1, 'image_id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1531709cfd9f41a0b45e9cae3f8241b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'created_at': datetime.datetime(2026, 9, 6, 5, 57, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 5, 57, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 06 08:10:45 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Trying to clone 03d622ef-3b8c-4ec0-8445-24a5762d7934 from image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}]). {{(pid=87307) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 08:10:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e1e01b1b-b104-4bd8-a21f-afbd8c6f0d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3ea1bff2-6037-471c-9af9-f175acdd2b08" returned: 0 in 0.286s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e1e01b1b-b104-4bd8-a21f-afbd8c6f0d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Lock "cinder-quobyte-3ea1bff2-6037-471c-9af9-f175acdd2b08" released by "delete_volume" :: held 0.874s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:10:45 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-e1e01b1b-b104-4bd8-a21f-afbd8c6f0d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Created reservations ['710861c0-9133-4e7b-8711-191d8be4bdc1', '121718f0-e008-41b6-a666-cd74ecef3c8e', '7abfd263-a243-4fb6-bab0-c706b0deb176', 'ee7caf73-ae1f-4b13-aab1-d1621264590d'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:10:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e1e01b1b-b104-4bd8-a21f-afbd8c6f0d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e1e01b1b-b104-4bd8-a21f-afbd8c6f0d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e1e01b1b-b104-4bd8-a21f-afbd8c6f0d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:10:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e1e01b1b-b104-4bd8-a21f-afbd8c6f0d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:10:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e1e01b1b-b104-4bd8-a21f-afbd8c6f0d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e1e01b1b-b104-4bd8-a21f-afbd8c6f0d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:45 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:10:45 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:45 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_k3338acadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 08:10:45 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Image download 20.69 MB at 20.69 MB/s Sep 06 08:10:45 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[10eaf0e5-108a-4a3b-876d-f190b7d87f1d]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:10:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_k3338acadevstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:45 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_k3338acadevstack@QuobyteHD Sep 06 08:10:45 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:45 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e1e01b1b-b104-4bd8-a21f-afbd8c6f0d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.312s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:45 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-e1e01b1b-b104-4bd8-a21f-afbd8c6f0d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:10:45 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e1e01b1b-b104-4bd8-a21f-afbd8c6f0d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Deleted volume successfully. Sep 06 08:10:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e1e01b1b-b104-4bd8-a21f-afbd8c6f0d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1576510745 None] Lock "cinder-3ea1bff2-6037-471c-9af9-f175acdd2b08-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:10:46 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_k3338acadevstack@QuobyteHD" returned: 0 in 0.501s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:46 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Temporary image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 is fetched for user 24876789eae14ecca338ffff08d91140. {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 08:10:46 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd50b856-d2b0-4d04-b5c1-3fd5885488e6]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:10:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_k3338acadevstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:46 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_k3338acadevstack@QuobyteHD Sep 06 08:10:46 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:46 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_k3338acadevstack@QuobyteHD" returned: 0 in 0.493s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1590802755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d622ef-3b8c-4ec0-8445-24a5762d7934,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='79a47a9504e64f8e84eefdbd2b49e415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:10:45Z,use_quota=True,user_id='24876789eae14ecca338ffff08d91140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:10:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Creating volume 03d622ef-3b8c-4ec0-8445-24a5762d7934 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:10:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:10:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:10:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:10:46 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:10:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-03d622ef-3b8c-4ec0-8445-24a5762d7934 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:46 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-03d622ef-3b8c-4ec0-8445-24a5762d7934 1073741824 Sep 06 08:10:46 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:47 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-03d622ef-3b8c-4ec0-8445-24a5762d7934 1073741824" returned: 0 in 0.684s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-03d622ef-3b8c-4ec0-8445-24a5762d7934 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:47 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-03d622ef-3b8c-4ec0-8445-24a5762d7934 Sep 06 08:10:47 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:47 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-03d622ef-3b8c-4ec0-8445-24a5762d7934" returned: 0 in 0.348s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:10:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:47 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Attempting download of 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}])) to volume 03d622ef-3b8c-4ec0-8445-24a5762d7934. {{(pid=87307) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 08:10:48 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e40b9c6-3804-4112-a089-8d2e7e084909]: (4, 'raw') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:10:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_emcd7sca {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:48 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_emcd7sca Sep 06 08:10:48 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:48 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_emcd7sca" returned: 0 in 0.385s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_emcd7sca {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:48 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_emcd7sca Sep 06 08:10:48 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:48 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_emcd7sca" returned: 1 in 0.387s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_emcd7sca' failed. Not Retrying. {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 08:10:48 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b4626b-30f1-4c6b-a31f-6bd8f4a067e1]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:10:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_k3338acadevstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:48 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_k3338acadevstack@QuobyteHD Sep 06 08:10:48 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:49 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_k3338acadevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:49 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 was qcow2, converting to qcow2 {{(pid=87307) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 08:10:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_k3338acadevstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-03d622ef-3b8c-4ec0-8445-24a5762d7934 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:49 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_k3338acadevstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-03d622ef-3b8c-4ec0-8445-24a5762d7934 Sep 06 08:10:49 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:52 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_k3338acadevstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-03d622ef-3b8c-4ec0-8445-24a5762d7934" returned: 0 in 3.018s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:52 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_k3338acadevstack@QuobyteHD, size 112.00 MB, duration 3.02 sec, destination /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-03d622ef-3b8c-4ec0-8445-24a5762d7934 {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:10:52 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Converted 112.00 MB image at 37.09 MB/s Sep 06 08:10:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-03d622ef-3b8c-4ec0-8445-24a5762d7934 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:52 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-03d622ef-3b8c-4ec0-8445-24a5762d7934 1G Sep 06 08:10:52 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:52 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-874b09de-c690-4419-b241-ae2b70315a55 req-83963d92-32f8-4b37-ab76-f80aed0ce628 tempest-AttachVolumeTestJSON-589724430 None] Terminate volume connection completed successfully. Sep 06 08:10:52 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-874b09de-c690-4419-b241-ae2b70315a55 req-83963d92-32f8-4b37-ab76-f80aed0ce628 tempest-AttachVolumeTestJSON-589724430 None] Deleting attachment 93125116-ef2d-47fa-bf7b-a498e6cf0ad5. {{(pid=87307) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 08:10:52 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-03d622ef-3b8c-4ec0-8445-24a5762d7934 1G" returned: 0 in 0.611s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:52 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Downloaded image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}])) to volume 03d622ef-3b8c-4ec0-8445-24a5762d7934 successfully. {{(pid=87307) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 08:10:52 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Temporary image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 for user 24876789eae14ecca338ffff08d91140 is deleted. {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 08:10:52 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Marking volume 03d622ef-3b8c-4ec0-8445-24a5762d7934 as bootable. {{(pid=87307) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 08:10:52 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Copying metadata from image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 to 03d622ef-3b8c-4ec0-8445-24a5762d7934. {{(pid=87307) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 08:10:52 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Creating volume glance metadata for volume 03d622ef-3b8c-4ec0-8445-24a5762d7934 backed by image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87307) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 08:10:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c36ba8-1ba7-4980-802a-a9dab5a3d9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03d622ef-3b8c-4ec0-8445-24a5762d7934', 'volume_size': 1, 'image_id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1531709cfd9f41a0b45e9cae3f8241b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'created_at': datetime.datetime(2026, 9, 6, 5, 57, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 5, 57, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c426b40-4a62-4ba0-b4cd-604952cd4fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:53 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Volume volume-03d622ef-3b8c-4ec0-8445-24a5762d7934 (03d622ef-3b8c-4ec0-8445-24a5762d7934): created successfully Sep 06 08:10:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c426b40-4a62-4ba0-b4cd-604952cd4fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Flow 'volume_create_manager' (8266b6ff-1874-4acd-9693-d10dd301723c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:10:53 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-452ed9d8-6675-4ce4-a85f-5563b98b134f tempest-VolumesGetTest-280735193 None] Created volume successfully. Sep 06 08:10:55 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:10:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Flow 'volume_create_manager' (253b256f-b82c-4e61-a4c9-4ba0bbb99a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:10:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59c98da0-6e8b-49a3-9b70-ecba568e5170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59c98da0-6e8b-49a3-9b70-ecba568e5170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:10:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-649851410',display_name='tempest-VolumesGetTest-Volume-1639782516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d735342-aa1c-430c-a0c3-2b70b593fd54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a47a9504e64f8e84eefdbd2b49e415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:10:55Z,use_quota=True,user_id='24876789eae14ecca338ffff08d91140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e9b73eb-893b-4c0c-a907-ab9e1d8121e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e9b73eb-893b-4c0c-a907-ab9e1d8121e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa145e4-1a1f-4cc5-9c4b-2a67a3372968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa145e4-1a1f-4cc5-9c4b-2a67a3372968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d735342-aa1c-430c-a0c3-2b70b593fd54', 'volume_name': 'volume-3d735342-aa1c-430c-a0c3-2b70b593fd54', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5419b8fb-211a-45f1-9054-b34ec8172c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5419b8fb-211a-45f1-9054-b34ec8172c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f366543-2a5f-4cb9-9126-265425072c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:55 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Volume 3d735342-aa1c-430c-a0c3-2b70b593fd54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d735342-aa1c-430c-a0c3-2b70b593fd54', 'volume_size': 1} Sep 06 08:10:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:10:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-649851410',display_name='tempest-VolumesGetTest-Volume-1639782516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d735342-aa1c-430c-a0c3-2b70b593fd54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a47a9504e64f8e84eefdbd2b49e415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:10:55Z,use_quota=True,user_id='24876789eae14ecca338ffff08d91140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:10:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Creating volume 3d735342-aa1c-430c-a0c3-2b70b593fd54 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:10:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:10:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:10:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:10:55 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:10:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3d735342-aa1c-430c-a0c3-2b70b593fd54 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:55 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3d735342-aa1c-430c-a0c3-2b70b593fd54 1073741824 Sep 06 08:10:55 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:55 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3d735342-aa1c-430c-a0c3-2b70b593fd54 1073741824" returned: 0 in 0.492s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3d735342-aa1c-430c-a0c3-2b70b593fd54 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:55 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3d735342-aa1c-430c-a0c3-2b70b593fd54 Sep 06 08:10:55 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:56 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3d735342-aa1c-430c-a0c3-2b70b593fd54" returned: 0 in 0.344s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f366543-2a5f-4cb9-9126-265425072c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d735342-aa1c-430c-a0c3-2b70b593fd54', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce158e3-af19-4fe1-b060-09c9aced62dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:56 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Volume volume-3d735342-aa1c-430c-a0c3-2b70b593fd54 (3d735342-aa1c-430c-a0c3-2b70b593fd54): created successfully Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce158e3-af19-4fe1-b060-09c9aced62dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Flow 'volume_create_manager' (253b256f-b82c-4e61-a4c9-4ba0bbb99a05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:10:56 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-0545fae4-decd-4500-b208-610c4f22481e tempest-VolumesGetTest-280735193 None] Created volume successfully. Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Flow 'volume_create_manager' (814cb9fb-2929-4c90-bba4-9c583d66b2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5b304f-d04e-451a-9645-daeccf25d77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5b304f-d04e-451a-9645-daeccf25d77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-726246199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0efdce-84f9-4f38-950c-78abbf4fa726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b10a04ca3cb46e9b5b89ffce4474183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:10:57Z,use_quota=True,user_id='3c83e713038e49a6816dbc6288a8b6e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb8ea84-f35f-4efa-92d1-473d62b42d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb8ea84-f35f-4efa-92d1-473d62b42d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115e9573-11f2-4af5-a73e-e2a265906d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115e9573-11f2-4af5-a73e-e2a265906d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b0efdce-84f9-4f38-950c-78abbf4fa726', 'volume_name': 'volume-4b0efdce-84f9-4f38-950c-78abbf4fa726', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (523d954d-dc07-409a-81d6-9d26be43a431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (523d954d-dc07-409a-81d6-9d26be43a431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b5fd5c-e252-4b99-9a82-d03ccd679008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:56 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Volume 4b0efdce-84f9-4f38-950c-78abbf4fa726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b0efdce-84f9-4f38-950c-78abbf4fa726', 'volume_size': 1} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-726246199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0efdce-84f9-4f38-950c-78abbf4fa726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b10a04ca3cb46e9b5b89ffce4474183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:10:57Z,use_quota=True,user_id='3c83e713038e49a6816dbc6288a8b6e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Creating volume 4b0efdce-84f9-4f38-950c-78abbf4fa726 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:10:56 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:10:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4b0efdce-84f9-4f38-950c-78abbf4fa726 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:56 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4b0efdce-84f9-4f38-950c-78abbf4fa726 1073741824 Sep 06 08:10:56 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:57 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4b0efdce-84f9-4f38-950c-78abbf4fa726 1073741824" returned: 0 in 0.776s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9ceb271f-0619-47a6-840c-cabe784ff72d tempest-VolumesGetTest-280735193 None] Acquiring lock "cinder-3d735342-aa1c-430c-a0c3-2b70b593fd54-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:10:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9ceb271f-0619-47a6-840c-cabe784ff72d tempest-VolumesGetTest-280735193 None] Lock "cinder-3d735342-aa1c-430c-a0c3-2b70b593fd54-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:10:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4b0efdce-84f9-4f38-950c-78abbf4fa726 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:57 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4b0efdce-84f9-4f38-950c-78abbf4fa726 Sep 06 08:10:57 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9ceb271f-0619-47a6-840c-cabe784ff72d tempest-VolumesGetTest-280735193 None] Acquiring lock "cinder-quobyte-3d735342-aa1c-430c-a0c3-2b70b593fd54" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:10:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9ceb271f-0619-47a6-840c-cabe784ff72d tempest-VolumesGetTest-280735193 None] Lock "cinder-quobyte-3d735342-aa1c-430c-a0c3-2b70b593fd54" acquired by "delete_volume" :: waited 0.042s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:10:58 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1ea794-8100-4ec7-b69f-c7ea8db00180]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:10:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9ceb271f-0619-47a6-840c-cabe784ff72d tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3d735342-aa1c-430c-a0c3-2b70b593fd54 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:58 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3d735342-aa1c-430c-a0c3-2b70b593fd54 Sep 06 08:10:58 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:58 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4b0efdce-84f9-4f38-950c-78abbf4fa726" returned: 0 in 0.649s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:58 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:10:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b5fd5c-e252-4b99-9a82-d03ccd679008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b0efdce-84f9-4f38-950c-78abbf4fa726', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ccf75c2-be90-4da1-a65f-21dfb5478d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:10:58 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Volume volume-4b0efdce-84f9-4f38-950c-78abbf4fa726 (4b0efdce-84f9-4f38-950c-78abbf4fa726): created successfully Sep 06 08:10:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ccf75c2-be90-4da1-a65f-21dfb5478d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:10:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Flow 'volume_create_manager' (814cb9fb-2929-4c90-bba4-9c583d66b2ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:10:58 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-9eebef03-7924-4a57-9c0f-33ae37359c5f tempest-VolumesListAdminTestJSON-1491914002 None] Created volume successfully. Sep 06 08:10:58 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9ceb271f-0619-47a6-840c-cabe784ff72d tempest-VolumesGetTest-280735193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3d735342-aa1c-430c-a0c3-2b70b593fd54" returned: 0 in 0.560s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9ceb271f-0619-47a6-840c-cabe784ff72d tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3d735342-aa1c-430c-a0c3-2b70b593fd54 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:58 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3d735342-aa1c-430c-a0c3-2b70b593fd54 Sep 06 08:10:58 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:59 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Sep 06 08:10:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9ceb271f-0619-47a6-840c-cabe784ff72d tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3d735342-aa1c-430c-a0c3-2b70b593fd54" returned: 0 in 0.702s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:10:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9ceb271f-0619-47a6-840c-cabe784ff72d tempest-VolumesGetTest-280735193 None] Lock "cinder-quobyte-3d735342-aa1c-430c-a0c3-2b70b593fd54" released by "delete_volume" :: held 1.398s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:10:59 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-9ceb271f-0619-47a6-840c-cabe784ff72d tempest-VolumesGetTest-280735193 None] Created reservations ['a61f4314-1f6f-4081-ad33-522f7c0a15a6', 'eff89c59-a4cd-4787-8d99-45928bd5d293', 'd48346c3-c60a-4b76-90ce-55fb3d3a1d57', '981be670-b6cc-4c37-8faa-da1dcb8b42ef'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:10:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:10:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:10:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:10:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:59 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:10:59 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:10:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9ceb271f-0619-47a6-840c-cabe784ff72d tempest-VolumesGetTest-280735193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:10:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9ceb271f-0619-47a6-840c-cabe784ff72d tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:10:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9ceb271f-0619-47a6-840c-cabe784ff72d tempest-VolumesGetTest-280735193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:10:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9ceb271f-0619-47a6-840c-cabe784ff72d tempest-VolumesGetTest-280735193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:10:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9ceb271f-0619-47a6-840c-cabe784ff72d tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:10:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9ceb271f-0619-47a6-840c-cabe784ff72d tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:10:59 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:10:59 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Flow 'volume_create_manager' (c5119953-b320-405a-b9de-b8c03e8a0087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:11:00 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287a8ac5-07f9-4215-b402-cfa69f89b071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.766s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager._thread_info {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread count: 28 {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread info: [<_MainThread(MainThread, started 139985167040640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287a8ac5-07f9-4215-b402-cfa69f89b071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1994179772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c500714-03b1-4d6d-a2ac-34c6561e3814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b10a04ca3cb46e9b5b89ffce4474183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:11:00Z,use_quota=True,user_id='3c83e713038e49a6816dbc6288a8b6e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ebc659-5e20-42b8-8050-c6872e16779f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ebc659-5e20-42b8-8050-c6872e16779f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc0025c-c16c-47db-ab7d-076c22a8f97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc0025c-c16c-47db-ab7d-076c22a8f97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c500714-03b1-4d6d-a2ac-34c6561e3814', 'volume_name': 'volume-2c500714-03b1-4d6d-a2ac-34c6561e3814', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dea3a83-0cd3-467c-8122-a1983ca61d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dea3a83-0cd3-467c-8122-a1983ca61d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f21faf-ee01-4451-9a8f-e3898e10c37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:00 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Volume 2c500714-03b1-4d6d-a2ac-34c6561e3814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c500714-03b1-4d6d-a2ac-34c6561e3814', 'volume_size': 1} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1994179772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c500714-03b1-4d6d-a2ac-34c6561e3814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b10a04ca3cb46e9b5b89ffce4474183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:11:00Z,use_quota=True,user_id='3c83e713038e49a6816dbc6288a8b6e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Creating volume 2c500714-03b1-4d6d-a2ac-34c6561e3814 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:11:00 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2c500714-03b1-4d6d-a2ac-34c6561e3814 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:00 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bfd0de6a-7063-4ca9-b521-a4a9f85f6e2f tempest-VolumesGetTest-280735193 None] Acquiring lock "cinder-03d622ef-3b8c-4ec0-8445-24a5762d7934-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9ceb271f-0619-47a6-840c-cabe784ff72d tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.818s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-9ceb271f-0619-47a6-840c-cabe784ff72d tempest-VolumesGetTest-280735193 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:11:00 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2c500714-03b1-4d6d-a2ac-34c6561e3814 1073741824 Sep 06 08:11:00 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:00 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-9ceb271f-0619-47a6-840c-cabe784ff72d tempest-VolumesGetTest-280735193 None] Deleted volume successfully. Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bfd0de6a-7063-4ca9-b521-a4a9f85f6e2f tempest-VolumesGetTest-280735193 None] Lock "cinder-03d622ef-3b8c-4ec0-8445-24a5762d7934-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9ceb271f-0619-47a6-840c-cabe784ff72d tempest-VolumesGetTest-280735193 None] Lock "cinder-3d735342-aa1c-430c-a0c3-2b70b593fd54-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bfd0de6a-7063-4ca9-b521-a4a9f85f6e2f tempest-VolumesGetTest-280735193 None] Acquiring lock "cinder-quobyte-03d622ef-3b8c-4ec0-8445-24a5762d7934" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bfd0de6a-7063-4ca9-b521-a4a9f85f6e2f tempest-VolumesGetTest-280735193 None] Lock "cinder-quobyte-03d622ef-3b8c-4ec0-8445-24a5762d7934" acquired by "delete_volume" :: waited 0.022s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:01 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a0890c-9295-4e2d-b434-8283a7bf4ad6]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:11:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bfd0de6a-7063-4ca9-b521-a4a9f85f6e2f tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-03d622ef-3b8c-4ec0-8445-24a5762d7934 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:01 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-03d622ef-3b8c-4ec0-8445-24a5762d7934 Sep 06 08:11:01 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:01 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bfd0de6a-7063-4ca9-b521-a4a9f85f6e2f tempest-VolumesGetTest-280735193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-03d622ef-3b8c-4ec0-8445-24a5762d7934" returned: 0 in 0.607s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bfd0de6a-7063-4ca9-b521-a4a9f85f6e2f tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-03d622ef-3b8c-4ec0-8445-24a5762d7934 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:01 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2c500714-03b1-4d6d-a2ac-34c6561e3814 1073741824" returned: 0 in 1.007s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:01 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-03d622ef-3b8c-4ec0-8445-24a5762d7934 Sep 06 08:11:01 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2c500714-03b1-4d6d-a2ac-34c6561e3814 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:01 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2c500714-03b1-4d6d-a2ac-34c6561e3814 Sep 06 08:11:01 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:02 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2c500714-03b1-4d6d-a2ac-34c6561e3814" returned: 0 in 0.349s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:02 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:11:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:02 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f21faf-ee01-4451-9a8f-e3898e10c37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c500714-03b1-4d6d-a2ac-34c6561e3814', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:02 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee291ce-5fcb-42b5-bcc1-75ddf534887c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:02 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Volume volume-2c500714-03b1-4d6d-a2ac-34c6561e3814 (2c500714-03b1-4d6d-a2ac-34c6561e3814): created successfully Sep 06 08:11:02 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee291ce-5fcb-42b5-bcc1-75ddf534887c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:02 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Flow 'volume_create_manager' (c5119953-b320-405a-b9de-b8c03e8a0087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:11:02 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-c6ab5bd9-f540-4839-a2da-cb4f17df0c74 tempest-VolumesListAdminTestJSON-1491914002 None] Created volume successfully. Sep 06 08:11:02 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bfd0de6a-7063-4ca9-b521-a4a9f85f6e2f tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-03d622ef-3b8c-4ec0-8445-24a5762d7934" returned: 0 in 0.536s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bfd0de6a-7063-4ca9-b521-a4a9f85f6e2f tempest-VolumesGetTest-280735193 None] Lock "cinder-quobyte-03d622ef-3b8c-4ec0-8445-24a5762d7934" released by "delete_volume" :: held 1.259s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:02 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-bfd0de6a-7063-4ca9-b521-a4a9f85f6e2f tempest-VolumesGetTest-280735193 None] Created reservations ['dc33eb05-f475-4b15-a35d-cd71d5cb2ec5', '049ff19f-75e0-4cd2-b9cd-4dd2fb6d044c', '281ef26b-1b58-4cea-9327-bb3f60838940', '0020433f-0d71-4d44-b49f-02718c91591d'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:11:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bfd0de6a-7063-4ca9-b521-a4a9f85f6e2f tempest-VolumesGetTest-280735193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bfd0de6a-7063-4ca9-b521-a4a9f85f6e2f tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:02 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bfd0de6a-7063-4ca9-b521-a4a9f85f6e2f tempest-VolumesGetTest-280735193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:11:02 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bfd0de6a-7063-4ca9-b521-a4a9f85f6e2f tempest-VolumesGetTest-280735193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:11:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bfd0de6a-7063-4ca9-b521-a4a9f85f6e2f tempest-VolumesGetTest-280735193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bfd0de6a-7063-4ca9-b521-a4a9f85f6e2f tempest-VolumesGetTest-280735193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:02 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:11:02 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:02 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bfd0de6a-7063-4ca9-b521-a4a9f85f6e2f tempest-VolumesGetTest-280735193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.261s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:02 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-bfd0de6a-7063-4ca9-b521-a4a9f85f6e2f tempest-VolumesGetTest-280735193 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:11:02 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-bfd0de6a-7063-4ca9-b521-a4a9f85f6e2f tempest-VolumesGetTest-280735193 None] Deleted volume successfully. Sep 06 08:11:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bfd0de6a-7063-4ca9-b521-a4a9f85f6e2f tempest-VolumesGetTest-280735193 None] Lock "cinder-03d622ef-3b8c-4ec0-8445-24a5762d7934-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:03 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:11:03 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Flow 'volume_create_manager' (bcf2bb45-225d-4185-aeae-b11957662cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:11:03 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ab1b37-f139-4f90-8cc5-63361a90612b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:03 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ab1b37-f139-4f90-8cc5-63361a90612b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1705178795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa2a392-47a3-4fbe-b9b8-100e0295c2b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b10a04ca3cb46e9b5b89ffce4474183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:11:03Z,use_quota=True,user_id='3c83e713038e49a6816dbc6288a8b6e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:03 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af377a5c-4862-4a3d-b325-3b67c8afc49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:03 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af377a5c-4862-4a3d-b325-3b67c8afc49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:03 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1390e714-1755-4d9f-ae73-5bd9d3af1d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:03 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1390e714-1755-4d9f-ae73-5bd9d3af1d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaa2a392-47a3-4fbe-b9b8-100e0295c2b8', 'volume_name': 'volume-aaa2a392-47a3-4fbe-b9b8-100e0295c2b8', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:03 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09d4866-df15-4765-ab58-f0a8e47b315d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:03 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09d4866-df15-4765-ab58-f0a8e47b315d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:03 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bf063d-8ad2-40cf-b985-e31740da39a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:03 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Volume aaa2a392-47a3-4fbe-b9b8-100e0295c2b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaa2a392-47a3-4fbe-b9b8-100e0295c2b8', 'volume_size': 1} Sep 06 08:11:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:03 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1705178795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa2a392-47a3-4fbe-b9b8-100e0295c2b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b10a04ca3cb46e9b5b89ffce4474183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:11:03Z,use_quota=True,user_id='3c83e713038e49a6816dbc6288a8b6e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:11:03 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Creating volume aaa2a392-47a3-4fbe-b9b8-100e0295c2b8 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:11:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:03 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:11:03 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:11:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:03 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:11:03 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:11:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aaa2a392-47a3-4fbe-b9b8-100e0295c2b8 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:03 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aaa2a392-47a3-4fbe-b9b8-100e0295c2b8 1073741824 Sep 06 08:11:03 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:04 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aaa2a392-47a3-4fbe-b9b8-100e0295c2b8 1073741824" returned: 0 in 0.575s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aaa2a392-47a3-4fbe-b9b8-100e0295c2b8 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:04 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aaa2a392-47a3-4fbe-b9b8-100e0295c2b8 Sep 06 08:11:04 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:04 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aaa2a392-47a3-4fbe-b9b8-100e0295c2b8" returned: 0 in 0.393s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:04 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:11:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bf063d-8ad2-40cf-b985-e31740da39a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaa2a392-47a3-4fbe-b9b8-100e0295c2b8', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee493da-68f1-433d-a0b9-dd4d53290cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:04 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Volume volume-aaa2a392-47a3-4fbe-b9b8-100e0295c2b8 (aaa2a392-47a3-4fbe-b9b8-100e0295c2b8): created successfully Sep 06 08:11:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee493da-68f1-433d-a0b9-dd4d53290cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Flow 'volume_create_manager' (bcf2bb45-225d-4185-aeae-b11957662cc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:11:04 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-7c5a2620-d8ba-4804-85a1-1811bc53119e tempest-VolumesListAdminTestJSON-1491914002 None] Created volume successfully. Sep 06 08:11:06 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:11:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Flow 'volume_create_manager' (582c7fa6-2ec0-4424-b5af-8ef185322742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:11:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca35e35-63a3-4500-a73a-dde5e69ffe43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca35e35-63a3-4500-a73a-dde5e69ffe43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=464cb85c-580e-48d8-8649-b35c5fc6cc8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d582b1cf3e478e972f5e4cecdd8e2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:11:07Z,use_quota=True,user_id='660ec48bc41f47e3a3afe1b20c8c1f87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243533cd-a1e0-403a-9d03-5327efdd4a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243533cd-a1e0-403a-9d03-5327efdd4a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8d51fd-bbe0-406c-a6d1-d7c55ed0b54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8d51fd-bbe0-406c-a6d1-d7c55ed0b54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '464cb85c-580e-48d8-8649-b35c5fc6cc8b', 'volume_name': 'volume-464cb85c-580e-48d8-8649-b35c5fc6cc8b', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f3c636-f6ac-45fd-b073-4730d54d2a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f3c636-f6ac-45fd-b073-4730d54d2a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f4a8be-5501-4991-bc23-e441a147d9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:06 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Volume 464cb85c-580e-48d8-8649-b35c5fc6cc8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-464cb85c-580e-48d8-8649-b35c5fc6cc8b', 'volume_size': 1} Sep 06 08:11:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=464cb85c-580e-48d8-8649-b35c5fc6cc8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d582b1cf3e478e972f5e4cecdd8e2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:11:07Z,use_quota=True,user_id='660ec48bc41f47e3a3afe1b20c8c1f87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:11:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Creating volume 464cb85c-580e-48d8-8649-b35c5fc6cc8b {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:11:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:11:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:11:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:11:06 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:11:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-464cb85c-580e-48d8-8649-b35c5fc6cc8b 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:06 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-464cb85c-580e-48d8-8649-b35c5fc6cc8b 1073741824 Sep 06 08:11:06 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:07 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-464cb85c-580e-48d8-8649-b35c5fc6cc8b 1073741824" returned: 0 in 0.543s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-464cb85c-580e-48d8-8649-b35c5fc6cc8b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:07 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-464cb85c-580e-48d8-8649-b35c5fc6cc8b Sep 06 08:11:07 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:07 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-464cb85c-580e-48d8-8649-b35c5fc6cc8b" returned: 0 in 0.344s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:11:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f4a8be-5501-4991-bc23-e441a147d9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-464cb85c-580e-48d8-8649-b35c5fc6cc8b', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76d5c258-d552-4d3e-b76f-3480a85ca058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:07 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Volume volume-464cb85c-580e-48d8-8649-b35c5fc6cc8b (464cb85c-580e-48d8-8649-b35c5fc6cc8b): created successfully Sep 06 08:11:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76d5c258-d552-4d3e-b76f-3480a85ca058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Flow 'volume_create_manager' (582c7fa6-2ec0-4424-b5af-8ef185322742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:11:07 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f41c0ea1-2572-4f0d-ad29-b370ec28cd2e tempest-VolumesListAdminTestJSON-2008105002 None] Created volume successfully. Sep 06 08:11:08 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-796aca9e-433b-441d-b502-7bdfee4647f2 tempest-VolumesListAdminTestJSON-2008105002 None] Acquiring lock "cinder-464cb85c-580e-48d8-8649-b35c5fc6cc8b-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:09 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-796aca9e-433b-441d-b502-7bdfee4647f2 tempest-VolumesListAdminTestJSON-2008105002 None] Lock "cinder-464cb85c-580e-48d8-8649-b35c5fc6cc8b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:09 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-796aca9e-433b-441d-b502-7bdfee4647f2 tempest-VolumesListAdminTestJSON-2008105002 None] Acquiring lock "cinder-quobyte-464cb85c-580e-48d8-8649-b35c5fc6cc8b" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:09 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-796aca9e-433b-441d-b502-7bdfee4647f2 tempest-VolumesListAdminTestJSON-2008105002 None] Lock "cinder-quobyte-464cb85c-580e-48d8-8649-b35c5fc6cc8b" acquired by "delete_volume" :: waited 0.030s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:09 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc97be48-0554-46b1-ae32-96f5be02818a]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:11:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-796aca9e-433b-441d-b502-7bdfee4647f2 tempest-VolumesListAdminTestJSON-2008105002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-464cb85c-580e-48d8-8649-b35c5fc6cc8b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:09 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3a469cfc-126b-4676-bb33-57d7ff325627 tempest-VolumesListAdminTestJSON-1491914002 None] Acquiring lock "cinder-aaa2a392-47a3-4fbe-b9b8-100e0295c2b8-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:09 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3a469cfc-126b-4676-bb33-57d7ff325627 tempest-VolumesListAdminTestJSON-1491914002 None] Lock "cinder-aaa2a392-47a3-4fbe-b9b8-100e0295c2b8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:09 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3a469cfc-126b-4676-bb33-57d7ff325627 tempest-VolumesListAdminTestJSON-1491914002 None] Acquiring lock "cinder-quobyte-aaa2a392-47a3-4fbe-b9b8-100e0295c2b8" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:09 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3a469cfc-126b-4676-bb33-57d7ff325627 tempest-VolumesListAdminTestJSON-1491914002 None] Lock "cinder-quobyte-aaa2a392-47a3-4fbe-b9b8-100e0295c2b8" acquired by "delete_volume" :: waited 0.021s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:09 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf50e4f0-e97c-4ca9-92d3-1e24ebc18dd4]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:11:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3a469cfc-126b-4676-bb33-57d7ff325627 tempest-VolumesListAdminTestJSON-1491914002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aaa2a392-47a3-4fbe-b9b8-100e0295c2b8 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:09 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-464cb85c-580e-48d8-8649-b35c5fc6cc8b Sep 06 08:11:09 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:09 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aaa2a392-47a3-4fbe-b9b8-100e0295c2b8 Sep 06 08:11:09 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:09 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-796aca9e-433b-441d-b502-7bdfee4647f2 tempest-VolumesListAdminTestJSON-2008105002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-464cb85c-580e-48d8-8649-b35c5fc6cc8b" returned: 0 in 0.513s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-796aca9e-433b-441d-b502-7bdfee4647f2 tempest-VolumesListAdminTestJSON-2008105002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-464cb85c-580e-48d8-8649-b35c5fc6cc8b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:09 devstack sudo[97763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-464cb85c-580e-48d8-8649-b35c5fc6cc8b Sep 06 08:11:09 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:09 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3a469cfc-126b-4676-bb33-57d7ff325627 tempest-VolumesListAdminTestJSON-1491914002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aaa2a392-47a3-4fbe-b9b8-100e0295c2b8" returned: 0 in 0.446s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3a469cfc-126b-4676-bb33-57d7ff325627 tempest-VolumesListAdminTestJSON-1491914002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aaa2a392-47a3-4fbe-b9b8-100e0295c2b8 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:09 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aaa2a392-47a3-4fbe-b9b8-100e0295c2b8 Sep 06 08:11:09 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:10 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-796aca9e-433b-441d-b502-7bdfee4647f2 tempest-VolumesListAdminTestJSON-2008105002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-464cb85c-580e-48d8-8649-b35c5fc6cc8b" returned: 0 in 0.371s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-796aca9e-433b-441d-b502-7bdfee4647f2 tempest-VolumesListAdminTestJSON-2008105002 None] Lock "cinder-quobyte-464cb85c-580e-48d8-8649-b35c5fc6cc8b" released by "delete_volume" :: held 0.969s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:10 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3a469cfc-126b-4676-bb33-57d7ff325627 tempest-VolumesListAdminTestJSON-1491914002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aaa2a392-47a3-4fbe-b9b8-100e0295c2b8" returned: 0 in 0.311s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3a469cfc-126b-4676-bb33-57d7ff325627 tempest-VolumesListAdminTestJSON-1491914002 None] Lock "cinder-quobyte-aaa2a392-47a3-4fbe-b9b8-100e0295c2b8" released by "delete_volume" :: held 0.807s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-796aca9e-433b-441d-b502-7bdfee4647f2 tempest-VolumesListAdminTestJSON-2008105002 None] Created reservations ['63f7bf0d-3e67-4135-8f34-3461381e90e4', 'eace351c-1fc4-421e-9ec4-f56b6bea4579', '29dacf56-b3f9-4a2f-a2b6-ea48ec0c0f8a', '19844c82-fc49-43de-86c9-ab020f621a1f'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-3a469cfc-126b-4676-bb33-57d7ff325627 tempest-VolumesListAdminTestJSON-1491914002 None] Created reservations ['c80e5895-5153-4a3c-9f76-85019e3f58f2', '9c05db39-7a6e-4fb3-88db-6873a4e0c7dc', 'a8a9e9a0-be76-4301-ab47-59137b33f453', '5f50b09d-b467-4d9f-8835-ce802f4b8610'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-796aca9e-433b-441d-b502-7bdfee4647f2 tempest-VolumesListAdminTestJSON-2008105002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-796aca9e-433b-441d-b502-7bdfee4647f2 tempest-VolumesListAdminTestJSON-2008105002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-796aca9e-433b-441d-b502-7bdfee4647f2 tempest-VolumesListAdminTestJSON-2008105002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-796aca9e-433b-441d-b502-7bdfee4647f2 tempest-VolumesListAdminTestJSON-2008105002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-796aca9e-433b-441d-b502-7bdfee4647f2 tempest-VolumesListAdminTestJSON-2008105002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-796aca9e-433b-441d-b502-7bdfee4647f2 tempest-VolumesListAdminTestJSON-2008105002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:10 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:11:10 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3a469cfc-126b-4676-bb33-57d7ff325627 tempest-VolumesListAdminTestJSON-1491914002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3a469cfc-126b-4676-bb33-57d7ff325627 tempest-VolumesListAdminTestJSON-1491914002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3a469cfc-126b-4676-bb33-57d7ff325627 tempest-VolumesListAdminTestJSON-1491914002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3a469cfc-126b-4676-bb33-57d7ff325627 tempest-VolumesListAdminTestJSON-1491914002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3a469cfc-126b-4676-bb33-57d7ff325627 tempest-VolumesListAdminTestJSON-1491914002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3a469cfc-126b-4676-bb33-57d7ff325627 tempest-VolumesListAdminTestJSON-1491914002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:10 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:11:10 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-927e4329-4423-403a-8e52-001e9354a0f5 tempest-VolumesListAdminTestJSON-1491914002 None] Acquiring lock "cinder-2c500714-03b1-4d6d-a2ac-34c6561e3814-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-927e4329-4423-403a-8e52-001e9354a0f5 tempest-VolumesListAdminTestJSON-1491914002 None] Lock "cinder-2c500714-03b1-4d6d-a2ac-34c6561e3814-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-927e4329-4423-403a-8e52-001e9354a0f5 tempest-VolumesListAdminTestJSON-1491914002 None] Acquiring lock "cinder-quobyte-2c500714-03b1-4d6d-a2ac-34c6561e3814" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-927e4329-4423-403a-8e52-001e9354a0f5 tempest-VolumesListAdminTestJSON-1491914002 None] Lock "cinder-quobyte-2c500714-03b1-4d6d-a2ac-34c6561e3814" acquired by "delete_volume" :: waited 0.029s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:10 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-796aca9e-433b-441d-b502-7bdfee4647f2 tempest-VolumesListAdminTestJSON-2008105002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.441s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-796aca9e-433b-441d-b502-7bdfee4647f2 tempest-VolumesListAdminTestJSON-2008105002 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8163331e-a9e9-4a60-9f52-216518dceba8]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-927e4329-4423-403a-8e52-001e9354a0f5 tempest-VolumesListAdminTestJSON-1491914002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2c500714-03b1-4d6d-a2ac-34c6561e3814 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:10 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-796aca9e-433b-441d-b502-7bdfee4647f2 tempest-VolumesListAdminTestJSON-2008105002 None] Deleted volume successfully. Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-796aca9e-433b-441d-b502-7bdfee4647f2 tempest-VolumesListAdminTestJSON-2008105002 None] Lock "cinder-464cb85c-580e-48d8-8649-b35c5fc6cc8b-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:10 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3a469cfc-126b-4676-bb33-57d7ff325627 tempest-VolumesListAdminTestJSON-1491914002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.544s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-3a469cfc-126b-4676-bb33-57d7ff325627 tempest-VolumesListAdminTestJSON-1491914002 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:11:10 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-3a469cfc-126b-4676-bb33-57d7ff325627 tempest-VolumesListAdminTestJSON-1491914002 None] Deleted volume successfully. Sep 06 08:11:10 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2c500714-03b1-4d6d-a2ac-34c6561e3814 Sep 06 08:11:10 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3a469cfc-126b-4676-bb33-57d7ff325627 tempest-VolumesListAdminTestJSON-1491914002 None] Lock "cinder-aaa2a392-47a3-4fbe-b9b8-100e0295c2b8-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:11 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-927e4329-4423-403a-8e52-001e9354a0f5 tempest-VolumesListAdminTestJSON-1491914002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2c500714-03b1-4d6d-a2ac-34c6561e3814" returned: 0 in 0.505s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-927e4329-4423-403a-8e52-001e9354a0f5 tempest-VolumesListAdminTestJSON-1491914002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2c500714-03b1-4d6d-a2ac-34c6561e3814 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:11 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2c500714-03b1-4d6d-a2ac-34c6561e3814 Sep 06 08:11:11 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:11 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-927e4329-4423-403a-8e52-001e9354a0f5 tempest-VolumesListAdminTestJSON-1491914002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2c500714-03b1-4d6d-a2ac-34c6561e3814" returned: 0 in 0.293s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:11 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-927e4329-4423-403a-8e52-001e9354a0f5 tempest-VolumesListAdminTestJSON-1491914002 None] Lock "cinder-quobyte-2c500714-03b1-4d6d-a2ac-34c6561e3814" released by "delete_volume" :: held 0.867s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:11 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-927e4329-4423-403a-8e52-001e9354a0f5 tempest-VolumesListAdminTestJSON-1491914002 None] Created reservations ['db6e5c61-384b-4a5f-9142-feac6e9458a5', 'c1f58aa6-186a-4f68-9f0c-97987cba32d6', 'a29f98d7-0e5b-44f2-9587-ddfe5ec4969f', '61f4ef6c-be2a-4ec6-aec5-162da6d2bc49'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:11:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-927e4329-4423-403a-8e52-001e9354a0f5 tempest-VolumesListAdminTestJSON-1491914002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-927e4329-4423-403a-8e52-001e9354a0f5 tempest-VolumesListAdminTestJSON-1491914002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-927e4329-4423-403a-8e52-001e9354a0f5 tempest-VolumesListAdminTestJSON-1491914002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:11:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-927e4329-4423-403a-8e52-001e9354a0f5 tempest-VolumesListAdminTestJSON-1491914002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:11:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-927e4329-4423-403a-8e52-001e9354a0f5 tempest-VolumesListAdminTestJSON-1491914002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-927e4329-4423-403a-8e52-001e9354a0f5 tempest-VolumesListAdminTestJSON-1491914002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:11 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:11:11 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:11 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3ff2f80a-a2bb-4de0-ae80-0fbe39a4c6c7 tempest-VolumesListAdminTestJSON-1491914002 None] Acquiring lock "cinder-4b0efdce-84f9-4f38-950c-78abbf4fa726-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:11 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3ff2f80a-a2bb-4de0-ae80-0fbe39a4c6c7 tempest-VolumesListAdminTestJSON-1491914002 None] Lock "cinder-4b0efdce-84f9-4f38-950c-78abbf4fa726-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:12 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3ff2f80a-a2bb-4de0-ae80-0fbe39a4c6c7 tempest-VolumesListAdminTestJSON-1491914002 None] Acquiring lock "cinder-quobyte-4b0efdce-84f9-4f38-950c-78abbf4fa726" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:12 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3ff2f80a-a2bb-4de0-ae80-0fbe39a4c6c7 tempest-VolumesListAdminTestJSON-1491914002 None] Lock "cinder-quobyte-4b0efdce-84f9-4f38-950c-78abbf4fa726" acquired by "delete_volume" :: waited 0.052s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:12 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a8ee33-45e0-43e9-9c12-71b06b190f23]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:11:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3ff2f80a-a2bb-4de0-ae80-0fbe39a4c6c7 tempest-VolumesListAdminTestJSON-1491914002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4b0efdce-84f9-4f38-950c-78abbf4fa726 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:12 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-927e4329-4423-403a-8e52-001e9354a0f5 tempest-VolumesListAdminTestJSON-1491914002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.466s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:12 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-927e4329-4423-403a-8e52-001e9354a0f5 tempest-VolumesListAdminTestJSON-1491914002 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:11:12 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-927e4329-4423-403a-8e52-001e9354a0f5 tempest-VolumesListAdminTestJSON-1491914002 None] Deleted volume successfully. Sep 06 08:11:12 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-927e4329-4423-403a-8e52-001e9354a0f5 tempest-VolumesListAdminTestJSON-1491914002 None] Lock "cinder-2c500714-03b1-4d6d-a2ac-34c6561e3814-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:12 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4b0efdce-84f9-4f38-950c-78abbf4fa726 Sep 06 08:11:12 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:12 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3ff2f80a-a2bb-4de0-ae80-0fbe39a4c6c7 tempest-VolumesListAdminTestJSON-1491914002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4b0efdce-84f9-4f38-950c-78abbf4fa726" returned: 0 in 0.397s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3ff2f80a-a2bb-4de0-ae80-0fbe39a4c6c7 tempest-VolumesListAdminTestJSON-1491914002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4b0efdce-84f9-4f38-950c-78abbf4fa726 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:12 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4b0efdce-84f9-4f38-950c-78abbf4fa726 Sep 06 08:11:12 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:12 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3ff2f80a-a2bb-4de0-ae80-0fbe39a4c6c7 tempest-VolumesListAdminTestJSON-1491914002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4b0efdce-84f9-4f38-950c-78abbf4fa726" returned: 0 in 0.255s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:12 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3ff2f80a-a2bb-4de0-ae80-0fbe39a4c6c7 tempest-VolumesListAdminTestJSON-1491914002 None] Lock "cinder-quobyte-4b0efdce-84f9-4f38-950c-78abbf4fa726" released by "delete_volume" :: held 0.704s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:12 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-3ff2f80a-a2bb-4de0-ae80-0fbe39a4c6c7 tempest-VolumesListAdminTestJSON-1491914002 None] Created reservations ['710927cd-30ba-4c9f-9d5d-c2db0fd83f54', 'f75b8a7a-1716-471b-a2d4-8d5ce6ce1260', '54534fb0-1daf-468d-944a-afe9a622b555', '9072139b-0fc0-4338-b5ac-ad0c47497827'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:11:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3ff2f80a-a2bb-4de0-ae80-0fbe39a4c6c7 tempest-VolumesListAdminTestJSON-1491914002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3ff2f80a-a2bb-4de0-ae80-0fbe39a4c6c7 tempest-VolumesListAdminTestJSON-1491914002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:12 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3ff2f80a-a2bb-4de0-ae80-0fbe39a4c6c7 tempest-VolumesListAdminTestJSON-1491914002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:11:12 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3ff2f80a-a2bb-4de0-ae80-0fbe39a4c6c7 tempest-VolumesListAdminTestJSON-1491914002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:11:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3ff2f80a-a2bb-4de0-ae80-0fbe39a4c6c7 tempest-VolumesListAdminTestJSON-1491914002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3ff2f80a-a2bb-4de0-ae80-0fbe39a4c6c7 tempest-VolumesListAdminTestJSON-1491914002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:13 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:11:13 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:13 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3ff2f80a-a2bb-4de0-ae80-0fbe39a4c6c7 tempest-VolumesListAdminTestJSON-1491914002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.347s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:13 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-3ff2f80a-a2bb-4de0-ae80-0fbe39a4c6c7 tempest-VolumesListAdminTestJSON-1491914002 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:11:13 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-3ff2f80a-a2bb-4de0-ae80-0fbe39a4c6c7 tempest-VolumesListAdminTestJSON-1491914002 None] Deleted volume successfully. Sep 06 08:11:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3ff2f80a-a2bb-4de0-ae80-0fbe39a4c6c7 tempest-VolumesListAdminTestJSON-1491914002 None] Lock "cinder-4b0efdce-84f9-4f38-950c-78abbf4fa726-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:22 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=92,cinder:UPDATE=130,cinder:INSERT=38,cinder:DELETE=11 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:11:23 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:UPDATE=111,cinder:SELECT=103,cinder:INSERT=42,cinder:DELETE=10 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:11:23 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:11:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Flow 'volume_create_manager' (90a77dc3-e901-4a0c-a49b-86d190cac9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:11:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b88e84-0932-4e0b-a194-7a12b0c11d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b88e84-0932-4e0b-a194-7a12b0c11d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-502580845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94fb7ad4-e97f-41df-a641-6e35defc199e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcbad88a782e408689751fb0f2ce5603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:11:23Z,use_quota=True,user_id='f5c77449a9bb44b990137b8ec3171970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1beb56f-2db8-4c2f-84da-c16e0f099e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1beb56f-2db8-4c2f-84da-c16e0f099e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed0f1a8-1839-4aea-a5c2-491c41b74c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed0f1a8-1839-4aea-a5c2-491c41b74c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94fb7ad4-e97f-41df-a641-6e35defc199e', 'volume_name': 'volume-94fb7ad4-e97f-41df-a641-6e35defc199e', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c2e37e-ad4e-477c-a8de-a906aba41d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c2e37e-ad4e-477c-a8de-a906aba41d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c20aafb-2e85-4146-8b5a-ff7ce4faf127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:23 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Volume 94fb7ad4-e97f-41df-a641-6e35defc199e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94fb7ad4-e97f-41df-a641-6e35defc199e', 'volume_size': 1} Sep 06 08:11:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-502580845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94fb7ad4-e97f-41df-a641-6e35defc199e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcbad88a782e408689751fb0f2ce5603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:11:23Z,use_quota=True,user_id='f5c77449a9bb44b990137b8ec3171970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:11:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Creating volume 94fb7ad4-e97f-41df-a641-6e35defc199e {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:11:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:11:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:11:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:11:23 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:11:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:23 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e 1073741824 Sep 06 08:11:23 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:24 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e 1073741824" returned: 0 in 0.487s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:24 devstack sudo[97823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e Sep 06 08:11:24 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Flow 'volume_create_manager' (f48ae06c-f38f-4b1d-b2cc-1f9e05499807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b173c9ed-1503-47f3-a975-fbfd70d56d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b173c9ed-1503-47f3-a975-fbfd70d56d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1922827912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5600adb3-904a-43da-a42d-bc89d2b74108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346653c205f34736853a83839bf68337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:11:24Z,use_quota=True,user_id='3223821bbbf74320a422c2ae31467ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5135e92-84d2-40a4-9234-9c2a36b80590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5135e92-84d2-40a4-9234-9c2a36b80590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ca1fb2-4e99-407c-8f88-8fc6fa7f603a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ca1fb2-4e99-407c-8f88-8fc6fa7f603a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5600adb3-904a-43da-a42d-bc89d2b74108', 'volume_name': 'volume-5600adb3-904a-43da-a42d-bc89d2b74108', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab20d8d-a06a-4966-8f47-81e1557de657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab20d8d-a06a-4966-8f47-81e1557de657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5cd1389-d917-4d24-8521-aafcd6fa0d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:24 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Volume 5600adb3-904a-43da-a42d-bc89d2b74108: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5600adb3-904a-43da-a42d-bc89d2b74108', 'volume_size': 1} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:24 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e" returned: 0 in 0.273s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.112s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1922827912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5600adb3-904a-43da-a42d-bc89d2b74108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346653c205f34736853a83839bf68337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:11:24Z,use_quota=True,user_id='3223821bbbf74320a422c2ae31467ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Creating volume 5600adb3-904a-43da-a42d-bc89d2b74108 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:11:24 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5600adb3-904a-43da-a42d-bc89d2b74108 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c20aafb-2e85-4146-8b5a-ff7ce4faf127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94fb7ad4-e97f-41df-a641-6e35defc199e', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b7670aa-cb54-47ba-bf6c-c303ced20aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:24 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5600adb3-904a-43da-a42d-bc89d2b74108 1073741824 Sep 06 08:11:24 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:24 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Volume volume-94fb7ad4-e97f-41df-a641-6e35defc199e (94fb7ad4-e97f-41df-a641-6e35defc199e): created successfully Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b7670aa-cb54-47ba-bf6c-c303ced20aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Flow 'volume_create_manager' (90a77dc3-e901-4a0c-a49b-86d190cac9dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:11:24 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-2cc2a767-7f88-4ae0-bec7-3194c644e9aa tempest-VolumesSnapshotTestJSON-149528372 None] Created volume successfully. Sep 06 08:11:24 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5600adb3-904a-43da-a42d-bc89d2b74108 1073741824" returned: 0 in 0.614s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5600adb3-904a-43da-a42d-bc89d2b74108 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:25 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5600adb3-904a-43da-a42d-bc89d2b74108 Sep 06 08:11:25 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:25 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5600adb3-904a-43da-a42d-bc89d2b74108" returned: 0 in 0.291s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:25 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:11:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:25 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5cd1389-d917-4d24-8521-aafcd6fa0d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5600adb3-904a-43da-a42d-bc89d2b74108', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:25 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7180e35-72c1-46b7-b96d-7791064d69c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:25 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Volume volume-5600adb3-904a-43da-a42d-bc89d2b74108 (5600adb3-904a-43da-a42d-bc89d2b74108): created successfully Sep 06 08:11:25 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7180e35-72c1-46b7-b96d-7791064d69c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:25 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Flow 'volume_create_manager' (f48ae06c-f38f-4b1d-b2cc-1f9e05499807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:11:25 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-187cd98d-700e-4b92-9b41-c6979f744719 tempest-VolumesTransfersTest-456288949 None] Created volume successfully. Sep 06 08:11:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-31eb6eb6-5c1b-4375-91d0-c72e1b944d39 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-31eb6eb6-5c1b-4375-91d0-c72e1b944d39 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:26 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-31eb6eb6-5c1b-4375-91d0-c72e1b944d39 tempest-VolumesSnapshotTestJSON-149528372 None] Creating offline snapshot e1235a9b-b1b5-4735-bdb5-47f86da4f47f of volume 94fb7ad4-e97f-41df-a641-6e35defc199e {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:11:26 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[41806729-1779-4ff8-b3c2-14caaac63ded]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:11:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-31eb6eb6-5c1b-4375-91d0-c72e1b944d39 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:26 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e Sep 06 08:11:26 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:26 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-31eb6eb6-5c1b-4375-91d0-c72e1b944d39 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e" returned: 0 in 0.459s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-31eb6eb6-5c1b-4375-91d0-c72e1b944d39 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.e1235a9b-b1b5-4735-bdb5-47f86da4f47f 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:26 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.e1235a9b-b1b5-4735-bdb5-47f86da4f47f 1G Sep 06 08:11:26 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:26 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-4f4e92c6-0b7c-4ab8-9634-29b0ce4314eb tempest-VolumesTransfersTest-523000351 None] Transfer volume completed successfully. Sep 06 08:11:26 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-31eb6eb6-5c1b-4375-91d0-c72e1b944d39 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.e1235a9b-b1b5-4735-bdb5-47f86da4f47f 1G" returned: 0 in 0.469s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-31eb6eb6-5c1b-4375-91d0-c72e1b944d39 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94fb7ad4-e97f-41df-a641-6e35defc199e -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.e1235a9b-b1b5-4735-bdb5-47f86da4f47f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:27 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94fb7ad4-e97f-41df-a641-6e35defc199e -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.e1235a9b-b1b5-4735-bdb5-47f86da4f47f Sep 06 08:11:27 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:27 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-31eb6eb6-5c1b-4375-91d0-c72e1b944d39 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94fb7ad4-e97f-41df-a641-6e35defc199e -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.e1235a9b-b1b5-4735-bdb5-47f86da4f47f" returned: 0 in 0.426s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:27 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-31eb6eb6-5c1b-4375-91d0-c72e1b944d39 tempest-VolumesSnapshotTestJSON-149528372 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.e1235a9b-b1b5-4735-bdb5-47f86da4f47f is being set with open permissions: ugo+rw Sep 06 08:11:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-31eb6eb6-5c1b-4375-91d0-c72e1b944d39 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.e1235a9b-b1b5-4735-bdb5-47f86da4f47f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:27 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.e1235a9b-b1b5-4735-bdb5-47f86da4f47f Sep 06 08:11:27 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b9dff823-1842-44de-a20a-8015c1293089 tempest-VolumesTransfersTest-906050663 None] Acquiring lock "cinder-5600adb3-904a-43da-a42d-bc89d2b74108-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b9dff823-1842-44de-a20a-8015c1293089 tempest-VolumesTransfersTest-906050663 None] Lock "cinder-5600adb3-904a-43da-a42d-bc89d2b74108-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b9dff823-1842-44de-a20a-8015c1293089 tempest-VolumesTransfersTest-906050663 None] Acquiring lock "cinder-quobyte-5600adb3-904a-43da-a42d-bc89d2b74108" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b9dff823-1842-44de-a20a-8015c1293089 tempest-VolumesTransfersTest-906050663 None] Lock "cinder-quobyte-5600adb3-904a-43da-a42d-bc89d2b74108" acquired by "delete_volume" :: waited 0.017s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:27 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c776f62-d1a3-4b0e-8a4e-69d3ab8f4ffd]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:11:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b9dff823-1842-44de-a20a-8015c1293089 tempest-VolumesTransfersTest-906050663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5600adb3-904a-43da-a42d-bc89d2b74108 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:27 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-31eb6eb6-5c1b-4375-91d0-c72e1b944d39 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.e1235a9b-b1b5-4735-bdb5-47f86da4f47f" returned: 0 in 0.298s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-31eb6eb6-5c1b-4375-91d0-c72e1b944d39 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:27 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.info Sep 06 08:11:27 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:27 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5600adb3-904a-43da-a42d-bc89d2b74108 Sep 06 08:11:27 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:28 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-31eb6eb6-5c1b-4375-91d0-c72e1b944d39 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.info" returned: 0 in 0.302s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:28 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-31eb6eb6-5c1b-4375-91d0-c72e1b944d39 tempest-VolumesSnapshotTestJSON-149528372 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.info is being set with open permissions: ugo+rw Sep 06 08:11:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-31eb6eb6-5c1b-4375-91d0-c72e1b944d39 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:28 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.info Sep 06 08:11:28 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:28 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b9dff823-1842-44de-a20a-8015c1293089 tempest-VolumesTransfersTest-906050663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5600adb3-904a-43da-a42d-bc89d2b74108" returned: 0 in 0.411s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b9dff823-1842-44de-a20a-8015c1293089 tempest-VolumesTransfersTest-906050663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5600adb3-904a-43da-a42d-bc89d2b74108 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:28 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5600adb3-904a-43da-a42d-bc89d2b74108 Sep 06 08:11:28 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:28 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-31eb6eb6-5c1b-4375-91d0-c72e1b944d39 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.info" returned: 0 in 0.289s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-31eb6eb6-5c1b-4375-91d0-c72e1b944d39 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.356s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:28 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b9dff823-1842-44de-a20a-8015c1293089 tempest-VolumesTransfersTest-906050663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5600adb3-904a-43da-a42d-bc89d2b74108" returned: 0 in 0.294s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b9dff823-1842-44de-a20a-8015c1293089 tempest-VolumesTransfersTest-906050663 None] Lock "cinder-quobyte-5600adb3-904a-43da-a42d-bc89d2b74108" released by "delete_volume" :: held 0.752s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:28 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-31eb6eb6-5c1b-4375-91d0-c72e1b944d39 tempest-VolumesSnapshotTestJSON-149528372 None] Create snapshot completed successfully Sep 06 08:11:28 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-b9dff823-1842-44de-a20a-8015c1293089 tempest-VolumesTransfersTest-906050663 None] Created reservations ['c51a3445-f312-46be-b272-089b6c52fa8c', '7deefa3d-dee0-4ae2-8780-74c3898a2222', 'df0d0b97-c27e-446d-9453-b53f8fe603ff', '72da08e8-5f6a-4e6f-834d-96c840675c75'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:11:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b9dff823-1842-44de-a20a-8015c1293089 tempest-VolumesTransfersTest-906050663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b9dff823-1842-44de-a20a-8015c1293089 tempest-VolumesTransfersTest-906050663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:28 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b9dff823-1842-44de-a20a-8015c1293089 tempest-VolumesTransfersTest-906050663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:11:28 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b9dff823-1842-44de-a20a-8015c1293089 tempest-VolumesTransfersTest-906050663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:11:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b9dff823-1842-44de-a20a-8015c1293089 tempest-VolumesTransfersTest-906050663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b9dff823-1842-44de-a20a-8015c1293089 tempest-VolumesTransfersTest-906050663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:28 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:11:28 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:28 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b9dff823-1842-44de-a20a-8015c1293089 tempest-VolumesTransfersTest-906050663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.266s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:28 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-b9dff823-1842-44de-a20a-8015c1293089 tempest-VolumesTransfersTest-906050663 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:11:28 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-b9dff823-1842-44de-a20a-8015c1293089 tempest-VolumesTransfersTest-906050663 None] Deleted volume successfully. Sep 06 08:11:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b9dff823-1842-44de-a20a-8015c1293089 tempest-VolumesTransfersTest-906050663 None] Lock "cinder-5600adb3-904a-43da-a42d-bc89d2b74108-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ed8f677a-6720-459d-a420-d832a6825d99 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "cinder-e1235a9b-b1b5-4735-bdb5-47f86da4f47f-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Flow 'volume_create_manager' (1f44a5f5-94c3-4628-9f53-203ff0dad976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f29ad1f-84a3-415e-a0be-75b3f8915275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ed8f677a-6720-459d-a420-d832a6825d99 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-e1235a9b-b1b5-4735-bdb5-47f86da4f47f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f29ad1f-84a3-415e-a0be-75b3f8915275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-12818277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4feb72d-d67e-4887-9637-c10d8b158c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346653c205f34736853a83839bf68337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:11:29Z,use_quota=True,user_id='3223821bbbf74320a422c2ae31467ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7d26cb-1c30-47d8-8c63-9a0783e81604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7d26cb-1c30-47d8-8c63-9a0783e81604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f15ea2a0-bcd4-4b1c-b8a4-92652c36d82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f15ea2a0-bcd4-4b1c-b8a4-92652c36d82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4feb72d-d67e-4887-9637-c10d8b158c17', 'volume_name': 'volume-f4feb72d-d67e-4887-9637-c10d8b158c17', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228b5c52-6db0-4281-91e1-8372ec6fab48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228b5c52-6db0-4281-91e1-8372ec6fab48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a300bf54-6b8b-4474-a472-353a02b81fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:29 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Volume f4feb72d-d67e-4887-9637-c10d8b158c17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4feb72d-d67e-4887-9637-c10d8b158c17', 'volume_size': 1} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-12818277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4feb72d-d67e-4887-9637-c10d8b158c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346653c205f34736853a83839bf68337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:11:29Z,use_quota=True,user_id='3223821bbbf74320a422c2ae31467ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Creating volume f4feb72d-d67e-4887-9637-c10d8b158c17 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:11:29 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4feb72d-d67e-4887-9637-c10d8b158c17 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:29 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4feb72d-d67e-4887-9637-c10d8b158c17 1073741824 Sep 06 08:11:29 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ed8f677a-6720-459d-a420-d832a6825d99 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "cinder-quobyte-94fb7ad4-e97f-41df-a641-6e35defc199e" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ed8f677a-6720-459d-a420-d832a6825d99 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-94fb7ad4-e97f-41df-a641-6e35defc199e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ed8f677a-6720-459d-a420-d832a6825d99 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "cinder-quobyte-e1235a9b-b1b5-4735-bdb5-47f86da4f47f" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ed8f677a-6720-459d-a420-d832a6825d99 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-e1235a9b-b1b5-4735-bdb5-47f86da4f47f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-ed8f677a-6720-459d-a420-d832a6825d99 tempest-VolumesSnapshotTestJSON-149528372 None] Deleting offline snapshot e1235a9b-b1b5-4735-bdb5-47f86da4f47f of volume 94fb7ad4-e97f-41df-a641-6e35defc199e {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-ed8f677a-6720-459d-a420-d832a6825d99 tempest-VolumesSnapshotTestJSON-149528372 None] snapshot_file for this snap is: volume-94fb7ad4-e97f-41df-a641-6e35defc199e.e1235a9b-b1b5-4735-bdb5-47f86da4f47f {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66cca1b-cd94-4c96-966c-6ef073577068]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed8f677a-6720-459d-a420-d832a6825d99 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.e1235a9b-b1b5-4735-bdb5-47f86da4f47f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:29 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.e1235a9b-b1b5-4735-bdb5-47f86da4f47f Sep 06 08:11:29 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:29 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4feb72d-d67e-4887-9637-c10d8b158c17 1073741824" returned: 0 in 0.484s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4feb72d-d67e-4887-9637-c10d8b158c17 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:30 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4feb72d-d67e-4887-9637-c10d8b158c17 Sep 06 08:11:30 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:30 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed8f677a-6720-459d-a420-d832a6825d99 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.e1235a9b-b1b5-4735-bdb5-47f86da4f47f" returned: 0 in 0.449s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:30 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-ed8f677a-6720-459d-a420-d832a6825d99 tempest-VolumesSnapshotTestJSON-149528372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94fb7ad4-e97f-41df-a641-6e35defc199e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:11:30 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d576b335-de29-4285-823d-cc13bcdc9b69]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:11:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed8f677a-6720-459d-a420-d832a6825d99 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:30 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e Sep 06 08:11:30 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:30 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4feb72d-d67e-4887-9637-c10d8b158c17" returned: 0 in 0.321s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:30 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:11:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a300bf54-6b8b-4474-a472-353a02b81fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4feb72d-d67e-4887-9637-c10d8b158c17', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0188a8b6-d487-4630-8a15-1045a86af8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:30 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Volume volume-f4feb72d-d67e-4887-9637-c10d8b158c17 (f4feb72d-d67e-4887-9637-c10d8b158c17): created successfully Sep 06 08:11:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0188a8b6-d487-4630-8a15-1045a86af8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Flow 'volume_create_manager' (1f44a5f5-94c3-4628-9f53-203ff0dad976) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:11:30 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-7d30d764-46f5-4fe7-b692-6e5be7ddc78f tempest-VolumesTransfersTest-456288949 None] Created volume successfully. Sep 06 08:11:30 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed8f677a-6720-459d-a420-d832a6825d99 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e" returned: 0 in 0.434s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed8f677a-6720-459d-a420-d832a6825d99 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.e1235a9b-b1b5-4735-bdb5-47f86da4f47f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:30 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.e1235a9b-b1b5-4735-bdb5-47f86da4f47f Sep 06 08:11:30 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:30 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed8f677a-6720-459d-a420-d832a6825d99 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.e1235a9b-b1b5-4735-bdb5-47f86da4f47f" returned: 0 in 0.427s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed8f677a-6720-459d-a420-d832a6825d99 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.e1235a9b-b1b5-4735-bdb5-47f86da4f47f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:30 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.e1235a9b-b1b5-4735-bdb5-47f86da4f47f Sep 06 08:11:30 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:31 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed8f677a-6720-459d-a420-d832a6825d99 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e.e1235a9b-b1b5-4735-bdb5-47f86da4f47f" returned: 0 in 0.290s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ed8f677a-6720-459d-a420-d832a6825d99 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-e1235a9b-b1b5-4735-bdb5-47f86da4f47f" released by "_delete_snapshot" :: held 1.740s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ed8f677a-6720-459d-a420-d832a6825d99 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-94fb7ad4-e97f-41df-a641-6e35defc199e" released by "delete_snapshot" :: held 1.775s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:31 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-ed8f677a-6720-459d-a420-d832a6825d99 tempest-VolumesSnapshotTestJSON-149528372 None] Created reservations ['d6a853ea-febc-4adc-bd0d-3b09ba7bc052', '6344467f-d72e-4fac-9298-8b995ac3118b', '8474ea42-21ba-4c45-a037-84804ed397c2', 'c8fc1478-6002-4863-a2e9-dc84d6eebc69'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:11:31 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-ed8f677a-6720-459d-a420-d832a6825d99 tempest-VolumesSnapshotTestJSON-149528372 None] Delete snapshot completed successfully. Sep 06 08:11:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ed8f677a-6720-459d-a420-d832a6825d99 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-e1235a9b-b1b5-4735-bdb5-47f86da4f47f-delete_snapshot" released by "delete_snapshot" :: held 2.100s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-41fc4a57-c316-4a6f-8c0c-3b138abf3f9e tempest-VolumesTransfersTest-906050663 None] Acquiring lock "cinder-f4feb72d-d67e-4887-9637-c10d8b158c17-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-41fc4a57-c316-4a6f-8c0c-3b138abf3f9e tempest-VolumesTransfersTest-906050663 None] Lock "cinder-f4feb72d-d67e-4887-9637-c10d8b158c17-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-41fc4a57-c316-4a6f-8c0c-3b138abf3f9e tempest-VolumesTransfersTest-906050663 None] Acquiring lock "cinder-quobyte-f4feb72d-d67e-4887-9637-c10d8b158c17" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-41fc4a57-c316-4a6f-8c0c-3b138abf3f9e tempest-VolumesTransfersTest-906050663 None] Lock "cinder-quobyte-f4feb72d-d67e-4887-9637-c10d8b158c17" acquired by "delete_volume" :: waited 0.025s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:31 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a46c7fc-5869-4cb8-9099-834f7a1a7fc9]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:11:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-41fc4a57-c316-4a6f-8c0c-3b138abf3f9e tempest-VolumesTransfersTest-906050663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4feb72d-d67e-4887-9637-c10d8b158c17 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:32 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4feb72d-d67e-4887-9637-c10d8b158c17 Sep 06 08:11:32 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:32 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:11:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Flow 'volume_create_manager' (0b1bca80-f988-420c-b5ce-92113e60121f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:11:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa7c74b-ca73-43c1-9ab7-5b147de729eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa7c74b-ca73-43c1-9ab7-5b147de729eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-343230395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63851020-e670-4d98-a615-c3e6616c09b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcbad88a782e408689751fb0f2ce5603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:11:32Z,use_quota=True,user_id='f5c77449a9bb44b990137b8ec3171970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367a2cf8-f856-430e-81c3-5fd898ee7b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367a2cf8-f856-430e-81c3-5fd898ee7b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f51425-080e-4537-ba81-21da7bb4ec4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f51425-080e-4537-ba81-21da7bb4ec4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63851020-e670-4d98-a615-c3e6616c09b2', 'volume_name': 'volume-63851020-e670-4d98-a615-c3e6616c09b2', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1687e658-47a1-4b96-9504-aa1ccfb1e7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1687e658-47a1-4b96-9504-aa1ccfb1e7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0df9d85-95c2-410c-b638-1a8ee61a75b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:32 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Volume 63851020-e670-4d98-a615-c3e6616c09b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63851020-e670-4d98-a615-c3e6616c09b2', 'volume_size': 1} Sep 06 08:11:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-343230395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63851020-e670-4d98-a615-c3e6616c09b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcbad88a782e408689751fb0f2ce5603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:11:32Z,use_quota=True,user_id='f5c77449a9bb44b990137b8ec3171970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:11:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Creating volume 63851020-e670-4d98-a615-c3e6616c09b2 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:11:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:11:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:11:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:11:32 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:11:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:32 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2 1073741824 Sep 06 08:11:32 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:32 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-41fc4a57-c316-4a6f-8c0c-3b138abf3f9e tempest-VolumesTransfersTest-906050663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4feb72d-d67e-4887-9637-c10d8b158c17" returned: 0 in 0.626s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-41fc4a57-c316-4a6f-8c0c-3b138abf3f9e tempest-VolumesTransfersTest-906050663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4feb72d-d67e-4887-9637-c10d8b158c17 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:32 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4feb72d-d67e-4887-9637-c10d8b158c17 Sep 06 08:11:32 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:33 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-41fc4a57-c316-4a6f-8c0c-3b138abf3f9e tempest-VolumesTransfersTest-906050663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4feb72d-d67e-4887-9637-c10d8b158c17" returned: 0 in 0.565s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:33 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-41fc4a57-c316-4a6f-8c0c-3b138abf3f9e tempest-VolumesTransfersTest-906050663 None] Lock "cinder-quobyte-f4feb72d-d67e-4887-9637-c10d8b158c17" released by "delete_volume" :: held 1.243s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:33 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-41fc4a57-c316-4a6f-8c0c-3b138abf3f9e tempest-VolumesTransfersTest-906050663 None] Created reservations ['c255daf6-dc7b-4d89-937c-6fb10317d084', '10e44e07-2e1c-400a-863d-7d705598a483', '4607204c-8656-49af-96f8-f2348b02b4d4', '426ad76c-cc85-49e5-ad10-a3d486e1452c'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:11:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-41fc4a57-c316-4a6f-8c0c-3b138abf3f9e tempest-VolumesTransfersTest-906050663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-41fc4a57-c316-4a6f-8c0c-3b138abf3f9e tempest-VolumesTransfersTest-906050663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-41fc4a57-c316-4a6f-8c0c-3b138abf3f9e tempest-VolumesTransfersTest-906050663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:11:33 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-41fc4a57-c316-4a6f-8c0c-3b138abf3f9e tempest-VolumesTransfersTest-906050663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:11:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-41fc4a57-c316-4a6f-8c0c-3b138abf3f9e tempest-VolumesTransfersTest-906050663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-41fc4a57-c316-4a6f-8c0c-3b138abf3f9e tempest-VolumesTransfersTest-906050663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2 1073741824" returned: 0 in 0.946s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:33 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:11:33 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:33 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2 Sep 06 08:11:33 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:33 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-12779076-fa6b-45ec-a33f-bf78c2950347 req-cedfabfb-cb89-4ee1-b1d9-5db32d08e66c tempest-TestShelveInstance-508546574 None] Terminate volume connection completed successfully. Sep 06 08:11:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-12779076-fa6b-45ec-a33f-bf78c2950347 req-cedfabfb-cb89-4ee1-b1d9-5db32d08e66c tempest-TestShelveInstance-508546574 None] Deleting attachment 84b41db8-b337-4cce-8c55-3b5999183ed2. {{(pid=87307) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 08:11:33 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-41fc4a57-c316-4a6f-8c0c-3b138abf3f9e tempest-VolumesTransfersTest-906050663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.485s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:33 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-41fc4a57-c316-4a6f-8c0c-3b138abf3f9e tempest-VolumesTransfersTest-906050663 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:11:33 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-41fc4a57-c316-4a6f-8c0c-3b138abf3f9e tempest-VolumesTransfersTest-906050663 None] Deleted volume successfully. Sep 06 08:11:34 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-41fc4a57-c316-4a6f-8c0c-3b138abf3f9e tempest-VolumesTransfersTest-906050663 None] Lock "cinder-f4feb72d-d67e-4887-9637-c10d8b158c17-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:34 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2" returned: 0 in 0.470s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:11:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:34 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0df9d85-95c2-410c-b638-1a8ee61a75b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63851020-e670-4d98-a615-c3e6616c09b2', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:34 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9fcf944-7b70-4153-8b2e-fba395594d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:34 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Volume volume-63851020-e670-4d98-a615-c3e6616c09b2 (63851020-e670-4d98-a615-c3e6616c09b2): created successfully Sep 06 08:11:34 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9fcf944-7b70-4153-8b2e-fba395594d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:34 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Flow 'volume_create_manager' (0b1bca80-f988-420c-b5ce-92113e60121f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:11:34 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-df556085-8826-4f7c-b21c-45def5a43a99 tempest-VolumesSnapshotTestJSON-149528372 None] Created volume successfully. Sep 06 08:11:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-4d711370-abf0-4bd2-9bc4-96789013be55 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-4d711370-abf0-4bd2-9bc4-96789013be55 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-4d711370-abf0-4bd2-9bc4-96789013be55 tempest-VolumesSnapshotTestJSON-149528372 None] Creating offline snapshot 985b959e-2f14-4ca8-8075-2721586f6849 of volume 63851020-e670-4d98-a615-c3e6616c09b2 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:11:34 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[890244fe-ee35-4fe6-b89a-dafad1ba2422]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:11:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4d711370-abf0-4bd2-9bc4-96789013be55 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:34 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2 Sep 06 08:11:34 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:35 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4d711370-abf0-4bd2-9bc4-96789013be55 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2" returned: 0 in 0.460s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4d711370-abf0-4bd2-9bc4-96789013be55 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.985b959e-2f14-4ca8-8075-2721586f6849 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:35 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.985b959e-2f14-4ca8-8075-2721586f6849 1G Sep 06 08:11:35 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:35 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4d711370-abf0-4bd2-9bc4-96789013be55 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.985b959e-2f14-4ca8-8075-2721586f6849 1G" returned: 0 in 0.602s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4d711370-abf0-4bd2-9bc4-96789013be55 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63851020-e670-4d98-a615-c3e6616c09b2 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.985b959e-2f14-4ca8-8075-2721586f6849 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:35 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63851020-e670-4d98-a615-c3e6616c09b2 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.985b959e-2f14-4ca8-8075-2721586f6849 Sep 06 08:11:35 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:36 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4d711370-abf0-4bd2-9bc4-96789013be55 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63851020-e670-4d98-a615-c3e6616c09b2 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.985b959e-2f14-4ca8-8075-2721586f6849" returned: 0 in 0.400s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:36 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-4d711370-abf0-4bd2-9bc4-96789013be55 tempest-VolumesSnapshotTestJSON-149528372 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.985b959e-2f14-4ca8-8075-2721586f6849 is being set with open permissions: ugo+rw Sep 06 08:11:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4d711370-abf0-4bd2-9bc4-96789013be55 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.985b959e-2f14-4ca8-8075-2721586f6849 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:36 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.985b959e-2f14-4ca8-8075-2721586f6849 Sep 06 08:11:36 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:36 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4d711370-abf0-4bd2-9bc4-96789013be55 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.985b959e-2f14-4ca8-8075-2721586f6849" returned: 0 in 0.295s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4d711370-abf0-4bd2-9bc4-96789013be55 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:36 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.info Sep 06 08:11:36 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:37 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4d711370-abf0-4bd2-9bc4-96789013be55 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.info" returned: 0 in 0.410s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:37 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-4d711370-abf0-4bd2-9bc4-96789013be55 tempest-VolumesSnapshotTestJSON-149528372 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.info is being set with open permissions: ugo+rw Sep 06 08:11:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4d711370-abf0-4bd2-9bc4-96789013be55 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:37 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.info Sep 06 08:11:37 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:37 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4d711370-abf0-4bd2-9bc4-96789013be55 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.info" returned: 0 in 0.585s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-4d711370-abf0-4bd2-9bc4-96789013be55 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.907s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:37 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-4d711370-abf0-4bd2-9bc4-96789013be55 tempest-VolumesSnapshotTestJSON-149528372 None] Create snapshot completed successfully Sep 06 08:11:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-533b57ca-c597-4777-8d6f-341be751c353 req-17868fd0-fe4a-41b7-b779-2cb358818051 tempest-TestShelveInstance-508546574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-533b57ca-c597-4777-8d6f-341be751c353 req-17868fd0-fe4a-41b7-b779-2cb358818051 tempest-TestShelveInstance-508546574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-533b57ca-c597-4777-8d6f-341be751c353 req-17868fd0-fe4a-41b7-b779-2cb358818051 tempest-TestShelveInstance-508546574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:38 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-533b57ca-c597-4777-8d6f-341be751c353 req-17868fd0-fe4a-41b7-b779-2cb358818051 tempest-TestShelveInstance-508546574 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0', 'name': 'volume-ec097093-111b-43cf-a782-bef47d4f824c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '87320824-fe3c-4f4d-a0de-b21055c550aa', 'enforce_multipath': True} {{(pid=87307) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 08:11:38 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-533b57ca-c597-4777-8d6f-341be751c353 req-17868fd0-fe4a-41b7-b779-2cb358818051 tempest-TestShelveInstance-508546574 None] attachment_update completed successfully. Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Flow 'volume_create_manager' (b7b0b3c4-3c0b-438d-a5c7-6c25cc64ca30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c70a39a-3ac8-4a47-a771-73db44db810a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c70a39a-3ac8-4a47-a771-73db44db810a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1461858249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd8b20cd-0b39-4120-88dd-9dec56091f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcbad88a782e408689751fb0f2ce5603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:11:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=985b959e-2f14-4ca8-8075-2721586f6849,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:11:39Z,use_quota=True,user_id='f5c77449a9bb44b990137b8ec3171970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc5080f-5907-46c4-abfd-1e28f7b44212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc5080f-5907-46c4-abfd-1e28f7b44212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d33703a-e381-410f-bee8-7d73f340e041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d33703a-e381-410f-bee8-7d73f340e041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cd8b20cd-0b39-4120-88dd-9dec56091f1b', 'volume_name': 'volume-cd8b20cd-0b39-4120-88dd-9dec56091f1b', 'volume_size': 2, 'snapshot_id': '985b959e-2f14-4ca8-8075-2721586f6849'}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2a7614-57b7-4211-b936-bad6749c5532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2a7614-57b7-4211-b936-bad6749c5532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91924c8-c8ad-4a6f-a191-197c929f4384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:39 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Volume cd8b20cd-0b39-4120-88dd-9dec56091f1b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cd8b20cd-0b39-4120-88dd-9dec56091f1b', 'volume_size': 2, 'snapshot_id': '985b959e-2f14-4ca8-8075-2721586f6849'} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "cinder-quobyte-985b959e-2f14-4ca8-8075-2721586f6849-cd8b20cd-0b39-4120-88dd-9dec56091f1b" by "_create_volume_from_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-985b959e-2f14-4ca8-8075-2721586f6849-cd8b20cd-0b39-4120-88dd-9dec56091f1b" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Creating volume cd8b20cd-0b39-4120-88dd-9dec56091f1b from snapshot 985b959e-2f14-4ca8-8075-2721586f6849 {{(pid=87307) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "cinder-quobyte-cd8b20cd-0b39-4120-88dd-9dec56091f1b" by "_copy_volume_from_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-cd8b20cd-0b39-4120-88dd-9dec56091f1b" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] snapshot: 985b959e-2f14-4ca8-8075-2721586f6849, volume: cd8b20cd-0b39-4120-88dd-9dec56091f1b, {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1783507-b189-43cb-9f09-e7f556fc1d3d]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:11:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.985b959e-2f14-4ca8-8075-2721586f6849 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:39 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.985b959e-2f14-4ca8-8075-2721586f6849 Sep 06 08:11:39 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:40 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.985b959e-2f14-4ca8-8075-2721586f6849" returned: 0 in 0.785s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63851020-e670-4d98-a615-c3e6616c09b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:11:40 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0edae8-a7d8-4f2b-80b2-abeb5fb8aa27]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:11:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:40 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2 Sep 06 08:11:40 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:40 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2" returned: 0 in 0.697s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] will copy from snapshot at /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2 {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 06 08:11:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Creating direct copy from snapshot {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 06 08:11:40 devstack cinder-volume[87307]: DEBUG cinder.utils [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Path /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd8b20cd-0b39-4120-88dd-9dec56091f1b not found in is_blk_device check {{(pid=87307) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 06 08:11:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd8b20cd-0b39-4120-88dd-9dec56091f1b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:40 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd8b20cd-0b39-4120-88dd-9dec56091f1b Sep 06 08:11:40 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:49 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=51,cinder:UPDATE=32,cinder:DELETE=6,cinder:INSERT=10 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:11:49 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=42,cinder:UPDATE=46,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:11:50 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd8b20cd-0b39-4120-88dd-9dec56091f1b" returned: 0 in 9.199s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:50 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Image conversion details: src /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2, size 1024.00 MB, duration 9.20 sec, destination /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd8b20cd-0b39-4120-88dd-9dec56091f1b {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:11:50 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Converted 1024.00 MB image at 111.30 MB/s Sep 06 08:11:50 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd8b20cd-0b39-4120-88dd-9dec56091f1b is being set with open permissions: ugo+rw Sep 06 08:11:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd8b20cd-0b39-4120-88dd-9dec56091f1b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:50 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd8b20cd-0b39-4120-88dd-9dec56091f1b Sep 06 08:11:50 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:50 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd8b20cd-0b39-4120-88dd-9dec56091f1b" returned: 0 in 0.634s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:50 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-cd8b20cd-0b39-4120-88dd-9dec56091f1b" released by "_copy_volume_from_snapshot" :: held 11.459s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:50 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-985b959e-2f14-4ca8-8075-2721586f6849-cd8b20cd-0b39-4120-88dd-9dec56091f1b" released by "_create_volume_from_snapshot" :: held 11.579s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.606s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91924c8-c8ad-4a6f-a191-197c929f4384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd8b20cd-0b39-4120-88dd-9dec56091f1b', 'volume_size': 2, 'snapshot_id': '985b959e-2f14-4ca8-8075-2721586f6849'}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (610e4d23-ef92-4722-a260-d5eaa6acca43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:50 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Volume volume-cd8b20cd-0b39-4120-88dd-9dec56091f1b (cd8b20cd-0b39-4120-88dd-9dec56091f1b): created successfully Sep 06 08:11:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (610e4d23-ef92-4722-a260-d5eaa6acca43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Flow 'volume_create_manager' (b7b0b3c4-3c0b-438d-a5c7-6c25cc64ca30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:11:50 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-6bf57d9a-9fd0-42f6-822b-c564ebcba090 tempest-VolumesSnapshotTestJSON-149528372 None] Created volume successfully. Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-239ceb08-eea9-4605-9bcb-7cfcec00a420 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "cinder-cd8b20cd-0b39-4120-88dd-9dec56091f1b-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-239ceb08-eea9-4605-9bcb-7cfcec00a420 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-cd8b20cd-0b39-4120-88dd-9dec56091f1b-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Flow 'volume_create_manager' (3a8e7dab-e963-4ff3-aabb-716b960b82d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91af313d-060f-4082-81b3-98e30ee82094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-239ceb08-eea9-4605-9bcb-7cfcec00a420 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "cinder-quobyte-cd8b20cd-0b39-4120-88dd-9dec56091f1b" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91af313d-060f-4082-81b3-98e30ee82094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-500312622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e9a7f04-3582-4342-866f-32458ce8deb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9afed559e0234b1f8941e2bb6ae88d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:11:52Z,use_quota=True,user_id='eb0d28cdfe3e4c8783e0597a3cc792fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c68244-bd4d-4c2e-8057-ed758d9d8248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c68244-bd4d-4c2e-8057-ed758d9d8248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5869cbe1-8475-45e7-be7f-9ae0fe76e84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5869cbe1-8475-45e7-be7f-9ae0fe76e84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e9a7f04-3582-4342-866f-32458ce8deb7', 'volume_name': 'volume-9e9a7f04-3582-4342-866f-32458ce8deb7', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8161b59f-0f09-45e8-a83f-d73fc80e9aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8161b59f-0f09-45e8-a83f-d73fc80e9aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b89043-015d-4b9a-9a3f-0367f2bcb427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:51 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Volume 9e9a7f04-3582-4342-866f-32458ce8deb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e9a7f04-3582-4342-866f-32458ce8deb7', 'volume_size': 1} Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-500312622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e9a7f04-3582-4342-866f-32458ce8deb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9afed559e0234b1f8941e2bb6ae88d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:11:52Z,use_quota=True,user_id='eb0d28cdfe3e4c8783e0597a3cc792fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Creating volume 9e9a7f04-3582-4342-866f-32458ce8deb7 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:11:51 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:11:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-239ceb08-eea9-4605-9bcb-7cfcec00a420 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-cd8b20cd-0b39-4120-88dd-9dec56091f1b" acquired by "delete_volume" :: waited 0.101s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:52 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7 1073741824 Sep 06 08:11:52 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:52 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc64f71-8113-4fb4-9048-7d35b6723942]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:11:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-239ceb08-eea9-4605-9bcb-7cfcec00a420 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd8b20cd-0b39-4120-88dd-9dec56091f1b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:52 devstack sudo[98623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd8b20cd-0b39-4120-88dd-9dec56091f1b Sep 06 08:11:52 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:52 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7 1073741824" returned: 0 in 0.608s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:52 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-239ceb08-eea9-4605-9bcb-7cfcec00a420 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd8b20cd-0b39-4120-88dd-9dec56091f1b" returned: 0 in 0.606s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-239ceb08-eea9-4605-9bcb-7cfcec00a420 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd8b20cd-0b39-4120-88dd-9dec56091f1b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:52 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7 Sep 06 08:11:52 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:52 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd8b20cd-0b39-4120-88dd-9dec56091f1b Sep 06 08:11:52 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:52 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7" returned: 0 in 0.348s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:11:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:53 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-239ceb08-eea9-4605-9bcb-7cfcec00a420 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-cd8b20cd-0b39-4120-88dd-9dec56091f1b" returned: 0 in 0.350s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b89043-015d-4b9a-9a3f-0367f2bcb427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e9a7f04-3582-4342-866f-32458ce8deb7', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895b31c4-d57b-4ac1-ab09-0d8fe87f4ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-239ceb08-eea9-4605-9bcb-7cfcec00a420 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-cd8b20cd-0b39-4120-88dd-9dec56091f1b" released by "delete_volume" :: held 1.035s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:53 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Volume volume-9e9a7f04-3582-4342-866f-32458ce8deb7 (9e9a7f04-3582-4342-866f-32458ce8deb7): created successfully Sep 06 08:11:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895b31c4-d57b-4ac1-ab09-0d8fe87f4ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Flow 'volume_create_manager' (3a8e7dab-e963-4ff3-aabb-716b960b82d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:11:53 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-ab14bf86-1e63-4d0b-b552-0161be4d400d tempest-VolumesCloneTest-351840439 None] Created volume successfully. Sep 06 08:11:53 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-239ceb08-eea9-4605-9bcb-7cfcec00a420 tempest-VolumesSnapshotTestJSON-149528372 None] Created reservations ['66af6c1e-cd86-4f76-9fff-a9eea29890db', '4e1b492f-de3e-490f-94f7-26a5c1c626c9', '967ce636-b371-4dc6-b199-983970a20dae', 'e9269c53-4b5c-415f-8205-366cda811009'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:11:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-239ceb08-eea9-4605-9bcb-7cfcec00a420 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-239ceb08-eea9-4605-9bcb-7cfcec00a420 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-239ceb08-eea9-4605-9bcb-7cfcec00a420 tempest-VolumesSnapshotTestJSON-149528372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:11:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-239ceb08-eea9-4605-9bcb-7cfcec00a420 tempest-VolumesSnapshotTestJSON-149528372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:11:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-239ceb08-eea9-4605-9bcb-7cfcec00a420 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-239ceb08-eea9-4605-9bcb-7cfcec00a420 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:53 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:11:53 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:53 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-239ceb08-eea9-4605-9bcb-7cfcec00a420 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.296s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:53 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-239ceb08-eea9-4605-9bcb-7cfcec00a420 tempest-VolumesSnapshotTestJSON-149528372 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:11:53 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-239ceb08-eea9-4605-9bcb-7cfcec00a420 tempest-VolumesSnapshotTestJSON-149528372 None] Deleted volume successfully. Sep 06 08:11:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-239ceb08-eea9-4605-9bcb-7cfcec00a420 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-cd8b20cd-0b39-4120-88dd-9dec56091f1b-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e8a1ec81-720e-4cf8-b0d4-0f126f817e09 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "cinder-985b959e-2f14-4ca8-8075-2721586f6849-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e8a1ec81-720e-4cf8-b0d4-0f126f817e09 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-985b959e-2f14-4ca8-8075-2721586f6849-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e8a1ec81-720e-4cf8-b0d4-0f126f817e09 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "cinder-quobyte-63851020-e670-4d98-a615-c3e6616c09b2" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e8a1ec81-720e-4cf8-b0d4-0f126f817e09 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-63851020-e670-4d98-a615-c3e6616c09b2" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e8a1ec81-720e-4cf8-b0d4-0f126f817e09 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "cinder-quobyte-985b959e-2f14-4ca8-8075-2721586f6849" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e8a1ec81-720e-4cf8-b0d4-0f126f817e09 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-985b959e-2f14-4ca8-8075-2721586f6849" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-e8a1ec81-720e-4cf8-b0d4-0f126f817e09 tempest-VolumesSnapshotTestJSON-149528372 None] Deleting offline snapshot 985b959e-2f14-4ca8-8075-2721586f6849 of volume 63851020-e670-4d98-a615-c3e6616c09b2 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-e8a1ec81-720e-4cf8-b0d4-0f126f817e09 tempest-VolumesSnapshotTestJSON-149528372 None] snapshot_file for this snap is: volume-63851020-e670-4d98-a615-c3e6616c09b2.985b959e-2f14-4ca8-8075-2721586f6849 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d72547-05d5-495b-915f-ca172d7e8181]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e8a1ec81-720e-4cf8-b0d4-0f126f817e09 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.985b959e-2f14-4ca8-8075-2721586f6849 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:11:54 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.985b959e-2f14-4ca8-8075-2721586f6849 Sep 06 08:11:54 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Flow 'volume_create_manager' (baa9eba3-bf8c-405d-84b7-e085fa967e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778ae19b-e6eb-4f0f-937a-2e79d6c7d367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778ae19b-e6eb-4f0f-937a-2e79d6c7d367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-756300709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c2cc3cd-9fe5-48ad-b014-195238cb97c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9afed559e0234b1f8941e2bb6ae88d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:11:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=9e9a7f04-3582-4342-866f-32458ce8deb7,status='creating',terminated_at=None,updated_at=2026-09-06T06:11:54Z,use_quota=True,user_id='eb0d28cdfe3e4c8783e0597a3cc792fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2346b3d1-ae79-4fe4-9dc4-7f5d1bbaeb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2346b3d1-ae79-4fe4-9dc4-7f5d1bbaeb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7eaa3f-bda5-4b58-9682-f721dcaa7178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7eaa3f-bda5-4b58-9682-f721dcaa7178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5c2cc3cd-9fe5-48ad-b014-195238cb97c4', 'volume_name': 'volume-5c2cc3cd-9fe5-48ad-b014-195238cb97c4', 'volume_size': 2, 'source_volid': '9e9a7f04-3582-4342-866f-32458ce8deb7', 'source_volstatus': 'available'}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4c6f02-6d6c-4bd9-9cd2-59f2b1704bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4c6f02-6d6c-4bd9-9cd2-59f2b1704bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d051566-62eb-40ff-8b77-fa3def8e5892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:54 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Volume 5c2cc3cd-9fe5-48ad-b014-195238cb97c4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5c2cc3cd-9fe5-48ad-b014-195238cb97c4', 'volume_size': 2, 'source_volid': '9e9a7f04-3582-4342-866f-32458ce8deb7', 'source_volstatus': 'available'} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:54 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Cloning volume 9e9a7f04-3582-4342-866f-32458ce8deb7 to volume 5c2cc3cd-9fe5-48ad-b014-195238cb97c4 Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Creating offline snapshot 3f7f306f-b4b3-47fb-a1ee-32e22107589e of volume 9e9a7f04-3582-4342-866f-32458ce8deb7 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90fabfc-a1bd-481d-a005-082690c4c377]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:54 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e8a1ec81-720e-4cf8-b0d4-0f126f817e09 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.985b959e-2f14-4ca8-8075-2721586f6849" returned: 0 in 0.430s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-e8a1ec81-720e-4cf8-b0d4-0f126f817e09 tempest-VolumesSnapshotTestJSON-149528372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63851020-e670-4d98-a615-c3e6616c09b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:11:54 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7 Sep 06 08:11:54 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb57e7f7-31ad-4da4-aa3e-80f5d2ae683d]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:11:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e8a1ec81-720e-4cf8-b0d4-0f126f817e09 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:54 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2 Sep 06 08:11:54 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:55 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7" returned: 0 in 0.436s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.3f7f306f-b4b3-47fb-a1ee-32e22107589e 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:55 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.3f7f306f-b4b3-47fb-a1ee-32e22107589e 1G Sep 06 08:11:55 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:55 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e8a1ec81-720e-4cf8-b0d4-0f126f817e09 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2" returned: 0 in 0.620s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e8a1ec81-720e-4cf8-b0d4-0f126f817e09 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.985b959e-2f14-4ca8-8075-2721586f6849 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:55 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.985b959e-2f14-4ca8-8075-2721586f6849 Sep 06 08:11:55 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:55 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.3f7f306f-b4b3-47fb-a1ee-32e22107589e 1G" returned: 0 in 0.518s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9a7f04-3582-4342-866f-32458ce8deb7 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.3f7f306f-b4b3-47fb-a1ee-32e22107589e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:55 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9a7f04-3582-4342-866f-32458ce8deb7 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.3f7f306f-b4b3-47fb-a1ee-32e22107589e Sep 06 08:11:55 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:55 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e8a1ec81-720e-4cf8-b0d4-0f126f817e09 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.985b959e-2f14-4ca8-8075-2721586f6849" returned: 0 in 0.353s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e8a1ec81-720e-4cf8-b0d4-0f126f817e09 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.985b959e-2f14-4ca8-8075-2721586f6849 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:55 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.985b959e-2f14-4ca8-8075-2721586f6849 Sep 06 08:11:55 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:55 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9a7f04-3582-4342-866f-32458ce8deb7 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.3f7f306f-b4b3-47fb-a1ee-32e22107589e" returned: 0 in 0.304s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:55 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.3f7f306f-b4b3-47fb-a1ee-32e22107589e is being set with open permissions: ugo+rw Sep 06 08:11:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.3f7f306f-b4b3-47fb-a1ee-32e22107589e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:55 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.3f7f306f-b4b3-47fb-a1ee-32e22107589e Sep 06 08:11:55 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:56 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e8a1ec81-720e-4cf8-b0d4-0f126f817e09 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2.985b959e-2f14-4ca8-8075-2721586f6849" returned: 0 in 0.260s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e8a1ec81-720e-4cf8-b0d4-0f126f817e09 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-985b959e-2f14-4ca8-8075-2721586f6849" released by "_delete_snapshot" :: held 1.807s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e8a1ec81-720e-4cf8-b0d4-0f126f817e09 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-63851020-e670-4d98-a615-c3e6616c09b2" released by "delete_snapshot" :: held 1.848s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:56 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.3f7f306f-b4b3-47fb-a1ee-32e22107589e" returned: 0 in 0.252s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:56 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.info Sep 06 08:11:56 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-e8a1ec81-720e-4cf8-b0d4-0f126f817e09 tempest-VolumesSnapshotTestJSON-149528372 None] Created reservations ['55350e9b-bc7d-4575-a68b-594e2091c8ee', '4700876f-c35c-487f-bffc-08c2a4dab831', 'fa92b4d5-a0ab-4803-8602-7af892923a27', 'c8ed5410-6a99-4ff8-9887-7f2362d314c3'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:11:56 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e8a1ec81-720e-4cf8-b0d4-0f126f817e09 tempest-VolumesSnapshotTestJSON-149528372 None] Delete snapshot completed successfully. Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e8a1ec81-720e-4cf8-b0d4-0f126f817e09 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-985b959e-2f14-4ca8-8075-2721586f6849-delete_snapshot" released by "delete_snapshot" :: held 2.114s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a5c9918b-32bd-487d-b486-86f0ba06edd8 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "cinder-63851020-e670-4d98-a615-c3e6616c09b2-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a5c9918b-32bd-487d-b486-86f0ba06edd8 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-63851020-e670-4d98-a615-c3e6616c09b2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a5c9918b-32bd-487d-b486-86f0ba06edd8 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "cinder-quobyte-63851020-e670-4d98-a615-c3e6616c09b2" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:56 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a5c9918b-32bd-487d-b486-86f0ba06edd8 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-63851020-e670-4d98-a615-c3e6616c09b2" acquired by "delete_volume" :: waited 0.029s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.info" returned: 0 in 0.373s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:56 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.info is being set with open permissions: ugo+rw Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3f3a8c-4e9d-4a71-a311-a25c155a8c6c]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a5c9918b-32bd-487d-b486-86f0ba06edd8 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:56 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.info Sep 06 08:11:56 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:56 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2 Sep 06 08:11:56 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:56 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.info" returned: 0 in 0.257s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Acquiring lock "cinder-quobyte-5c2cc3cd-9fe5-48ad-b014-195238cb97c4" by "_copy_volume_from_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Lock "cinder-quobyte-5c2cc3cd-9fe5-48ad-b014-195238cb97c4" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] snapshot: 3f7f306f-b4b3-47fb-a1ee-32e22107589e, volume: 5c2cc3cd-9fe5-48ad-b014-195238cb97c4, {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ff6f54-a133-44d6-8cfb-844cf33afac9]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.3f7f306f-b4b3-47fb-a1ee-32e22107589e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:56 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a5c9918b-32bd-487d-b486-86f0ba06edd8 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2" returned: 0 in 0.389s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a5c9918b-32bd-487d-b486-86f0ba06edd8 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:56 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2 Sep 06 08:11:56 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:57 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.3f7f306f-b4b3-47fb-a1ee-32e22107589e Sep 06 08:11:57 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:57 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a5c9918b-32bd-487d-b486-86f0ba06edd8 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63851020-e670-4d98-a615-c3e6616c09b2" returned: 0 in 0.266s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a5c9918b-32bd-487d-b486-86f0ba06edd8 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-63851020-e670-4d98-a615-c3e6616c09b2" released by "delete_volume" :: held 0.726s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:57 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-a5c9918b-32bd-487d-b486-86f0ba06edd8 tempest-VolumesSnapshotTestJSON-149528372 None] Created reservations ['ef34a28d-670b-4a83-8e4a-7f3fe39d2497', '479cfbae-6569-4459-a413-7a8889843cdc', '2b1efb40-098e-4b30-b9b2-490759d40fb7', '7a28f05b-23f6-4e93-a29b-b7d88924fa9f'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:11:57 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.3f7f306f-b4b3-47fb-a1ee-32e22107589e" returned: 0 in 0.403s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e9a7f04-3582-4342-866f-32458ce8deb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:11:57 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[90eb4031-9439-49e8-a118-19bff3cd2064]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:11:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a5c9918b-32bd-487d-b486-86f0ba06edd8 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a5c9918b-32bd-487d-b486-86f0ba06edd8 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a5c9918b-32bd-487d-b486-86f0ba06edd8 tempest-VolumesSnapshotTestJSON-149528372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:11:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a5c9918b-32bd-487d-b486-86f0ba06edd8 tempest-VolumesSnapshotTestJSON-149528372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:11:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a5c9918b-32bd-487d-b486-86f0ba06edd8 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a5c9918b-32bd-487d-b486-86f0ba06edd8 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:57 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:11:57 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:57 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7 Sep 06 08:11:57 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:57 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a5c9918b-32bd-487d-b486-86f0ba06edd8 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.259s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:57 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-a5c9918b-32bd-487d-b486-86f0ba06edd8 tempest-VolumesSnapshotTestJSON-149528372 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:11:57 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-a5c9918b-32bd-487d-b486-86f0ba06edd8 tempest-VolumesSnapshotTestJSON-149528372 None] Deleted volume successfully. Sep 06 08:11:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a5c9918b-32bd-487d-b486-86f0ba06edd8 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-63851020-e670-4d98-a615-c3e6616c09b2-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:11:57 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Sep 06 08:11:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7" returned: 0 in 0.473s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:11:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] will copy from snapshot at /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7 {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 06 08:11:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Creating direct copy from snapshot {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 06 08:11:57 devstack cinder-volume[87307]: DEBUG cinder.utils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Path /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5c2cc3cd-9fe5-48ad-b014-195238cb97c4 not found in is_blk_device check {{(pid=87307) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 06 08:11:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5c2cc3cd-9fe5-48ad-b014-195238cb97c4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:57 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5c2cc3cd-9fe5-48ad-b014-195238cb97c4 Sep 06 08:11:57 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:11:58 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:11:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Flow 'volume_create_manager' (e101289e-cdef-48a6-88fa-105a1778ceb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:11:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3716ee8-40cd-4649-883e-21aed72a1739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3716ee8-40cd-4649-883e-21aed72a1739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1191585006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8c2c924-f5c5-4131-bc3a-97bb56583e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcbad88a782e408689751fb0f2ce5603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:11:58Z,use_quota=True,user_id='f5c77449a9bb44b990137b8ec3171970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33d09e94-8cc5-4f5d-a435-8b2af551a342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33d09e94-8cc5-4f5d-a435-8b2af551a342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (418bc837-b9a5-4143-8c5d-51e280451a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (418bc837-b9a5-4143-8c5d-51e280451a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8c2c924-f5c5-4131-bc3a-97bb56583e38', 'volume_name': 'volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (135e5464-d2fb-4e9f-bd6f-4629f4007442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (135e5464-d2fb-4e9f-bd6f-4629f4007442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:11:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a0b5a2b-ba92-42e3-918f-0fe665fd999d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:11:58 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Volume b8c2c924-f5c5-4131-bc3a-97bb56583e38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38', 'volume_size': 1} Sep 06 08:11:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:11:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:11:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:11:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:11:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:11:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:11:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:11:59 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:11:59 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:00 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 1.244s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:00 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:12:00 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager._thread_info {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:12:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread count: 28 {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 08:12:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread info: [<_MainThread(MainThread, started 139985167040640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:12:05 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Flow 'volume_create_manager' (cf3ee451-96b0-4297-9f18-39e4f7fffb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7582935-61d4-410f-adee-ea60a60da244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5c2cc3cd-9fe5-48ad-b014-195238cb97c4" returned: 0 in 7.279s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Image conversion details: src /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7, size 1024.00 MB, duration 7.28 sec, destination /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5c2cc3cd-9fe5-48ad-b014-195238cb97c4 {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:12:05 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Converted 1024.00 MB image at 140.66 MB/s Sep 06 08:12:05 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5c2cc3cd-9fe5-48ad-b014-195238cb97c4 is being set with open permissions: ugo+rw Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5c2cc3cd-9fe5-48ad-b014-195238cb97c4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7582935-61d4-410f-adee-ea60a60da244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-798210416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311534a9-9c1d-4485-87fa-24a3976fbb66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9744cd0efc514feb9fbd9c01c7dc5172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:05Z,use_quota=True,user_id='aa6ff475541c4943bced009193f3b662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:05 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5c2cc3cd-9fe5-48ad-b014-195238cb97c4 Sep 06 08:12:05 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ded9bdd-dfbe-47c0-948a-d0e76e785c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ded9bdd-dfbe-47c0-948a-d0e76e785c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71613492-41c2-4e91-9868-a40db73c7441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71613492-41c2-4e91-9868-a40db73c7441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '311534a9-9c1d-4485-87fa-24a3976fbb66', 'volume_name': 'volume-311534a9-9c1d-4485-87fa-24a3976fbb66', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b8d84b-fe4c-47ba-aece-79b3f42d3ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b8d84b-fe4c-47ba-aece-79b3f42d3ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (574871c1-c4f1-4505-ba76-a2da3f931144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:05 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Volume 311534a9-9c1d-4485-87fa-24a3976fbb66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-311534a9-9c1d-4485-87fa-24a3976fbb66', 'volume_size': 1} Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:05 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5c2cc3cd-9fe5-48ad-b014-195238cb97c4" returned: 0 in 0.297s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Lock "cinder-quobyte-5c2cc3cd-9fe5-48ad-b014-195238cb97c4" released by "_copy_volume_from_snapshot" :: held 8.537s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Acquiring lock "cinder-quobyte-3f7f306f-b4b3-47fb-a1ee-32e22107589e" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Lock "cinder-quobyte-3f7f306f-b4b3-47fb-a1ee-32e22107589e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Deleting offline snapshot 3f7f306f-b4b3-47fb-a1ee-32e22107589e of volume 9e9a7f04-3582-4342-866f-32458ce8deb7 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] snapshot_file for this snap is: volume-9e9a7f04-3582-4342-866f-32458ce8deb7.3f7f306f-b4b3-47fb-a1ee-32e22107589e {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[92aced8f-a924-48ff-8fc4-eae17c54eb5f]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.3f7f306f-b4b3-47fb-a1ee-32e22107589e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:05 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.3f7f306f-b4b3-47fb-a1ee-32e22107589e Sep 06 08:12:05 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:05 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.3f7f306f-b4b3-47fb-a1ee-32e22107589e" returned: 0 in 0.393s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e9a7f04-3582-4342-866f-32458ce8deb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[48767b3f-a1ef-4667-9ed3-a0eaa2d39c80]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:06 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7 Sep 06 08:12:06 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:06 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7" returned: 0 in 0.519s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.3f7f306f-b4b3-47fb-a1ee-32e22107589e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:06 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.3f7f306f-b4b3-47fb-a1ee-32e22107589e Sep 06 08:12:06 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:06 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.3f7f306f-b4b3-47fb-a1ee-32e22107589e" returned: 0 in 0.326s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.3f7f306f-b4b3-47fb-a1ee-32e22107589e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:06 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.3f7f306f-b4b3-47fb-a1ee-32e22107589e Sep 06 08:12:06 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:06 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7.3f7f306f-b4b3-47fb-a1ee-32e22107589e" returned: 0 in 0.250s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Lock "cinder-quobyte-3f7f306f-b4b3-47fb-a1ee-32e22107589e" released by "_delete_snapshot" :: held 1.592s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.476s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.647s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1191585006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8c2c924-f5c5-4131-bc3a-97bb56583e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcbad88a782e408689751fb0f2ce5603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:11:58Z,use_quota=True,user_id='f5c77449a9bb44b990137b8ec3171970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Creating volume b8c2c924-f5c5-4131-bc3a-97bb56583e38 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:12:07 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d051566-62eb-40ff-8b77-fa3def8e5892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c2cc3cd-9fe5-48ad-b014-195238cb97c4', 'volume_size': 2, 'source_volid': '9e9a7f04-3582-4342-866f-32458ce8deb7', 'source_volstatus': 'available'}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:07 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38 1073741824 Sep 06 08:12:07 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17bf13e7-9316-430d-8ae0-df44218c1284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:07 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Volume volume-5c2cc3cd-9fe5-48ad-b014-195238cb97c4 (5c2cc3cd-9fe5-48ad-b014-195238cb97c4): created successfully Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17bf13e7-9316-430d-8ae0-df44218c1284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Flow 'volume_create_manager' (baa9eba3-bf8c-405d-84b7-e085fa967e25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:07 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-70e6ad5c-39f1-4652-8917-58edea04641c tempest-VolumesCloneTest-351840439 None] Created volume successfully. Sep 06 08:12:07 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38 1073741824" returned: 0 in 0.437s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:07 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38 Sep 06 08:12:07 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:07 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38" returned: 0 in 0.240s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.624s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-798210416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311534a9-9c1d-4485-87fa-24a3976fbb66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9744cd0efc514feb9fbd9c01c7dc5172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:05Z,use_quota=True,user_id='aa6ff475541c4943bced009193f3b662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Creating volume 311534a9-9c1d-4485-87fa-24a3976fbb66 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:12:07 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-311534a9-9c1d-4485-87fa-24a3976fbb66 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a0b5a2b-ba92-42e3-918f-0fe665fd999d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:07 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-311534a9-9c1d-4485-87fa-24a3976fbb66 1073741824 Sep 06 08:12:07 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1ebcc95-e5bb-430b-b977-f36278489c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:07 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Volume volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38 (b8c2c924-f5c5-4131-bc3a-97bb56583e38): created successfully Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1ebcc95-e5bb-430b-b977-f36278489c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Flow 'volume_create_manager' (e101289e-cdef-48a6-88fa-105a1778ceb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:07 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-5bb685ea-699b-449a-86bf-ed8ea9ff1c5c tempest-VolumesSnapshotTestJSON-149528372 None] Created volume successfully. Sep 06 08:12:08 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-311534a9-9c1d-4485-87fa-24a3976fbb66 1073741824" returned: 0 in 0.438s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-311534a9-9c1d-4485-87fa-24a3976fbb66 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:08 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-311534a9-9c1d-4485-87fa-24a3976fbb66 Sep 06 08:12:08 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:08 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-94109e41-46cf-4877-85f3-fc1043f6b02e tempest-VolumesCloneTest-351840439 None] Acquiring lock "cinder-5c2cc3cd-9fe5-48ad-b014-195238cb97c4-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:08 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-94109e41-46cf-4877-85f3-fc1043f6b02e tempest-VolumesCloneTest-351840439 None] Lock "cinder-5c2cc3cd-9fe5-48ad-b014-195238cb97c4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:08 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:08 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-94109e41-46cf-4877-85f3-fc1043f6b02e tempest-VolumesCloneTest-351840439 None] Acquiring lock "cinder-quobyte-5c2cc3cd-9fe5-48ad-b014-195238cb97c4" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-311534a9-9c1d-4485-87fa-24a3976fbb66" returned: 0 in 0.250s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:08 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:12:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:08 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-94109e41-46cf-4877-85f3-fc1043f6b02e tempest-VolumesCloneTest-351840439 None] Lock "cinder-quobyte-5c2cc3cd-9fe5-48ad-b014-195238cb97c4" acquired by "delete_volume" :: waited 0.027s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (574871c1-c4f1-4505-ba76-a2da3f931144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-311534a9-9c1d-4485-87fa-24a3976fbb66', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf16d6d1-677a-45dc-a965-3950f785ea74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:08 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79e6c36-3d9b-49c2-8f10-b8f525b6934a]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-94109e41-46cf-4877-85f3-fc1043f6b02e tempest-VolumesCloneTest-351840439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5c2cc3cd-9fe5-48ad-b014-195238cb97c4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:08 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Volume volume-311534a9-9c1d-4485-87fa-24a3976fbb66 (311534a9-9c1d-4485-87fa-24a3976fbb66): created successfully Sep 06 08:12:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf16d6d1-677a-45dc-a965-3950f785ea74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Flow 'volume_create_manager' (cf3ee451-96b0-4297-9f18-39e4f7fffb17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:08 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-53a9e2f4-b7e0-468b-936b-2718bc3347b4 tempest-AttachVolumeTestJSON-589724430 None] Created volume successfully. Sep 06 08:12:08 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5c2cc3cd-9fe5-48ad-b014-195238cb97c4 Sep 06 08:12:08 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-14b73c20-cfad-42fe-800e-2a6b3a84e3e0 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-14b73c20-cfad-42fe-800e-2a6b3a84e3e0 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:08 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-14b73c20-cfad-42fe-800e-2a6b3a84e3e0 tempest-VolumesSnapshotTestJSON-149528372 None] Creating offline snapshot b1553aa8-0341-4bd1-825e-516f185d7c13 of volume b8c2c924-f5c5-4131-bc3a-97bb56583e38 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:12:08 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0563dc6e-46b1-4e33-927b-d2fc44470581]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-14b73c20-cfad-42fe-800e-2a6b3a84e3e0 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:08 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-94109e41-46cf-4877-85f3-fc1043f6b02e tempest-VolumesCloneTest-351840439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5c2cc3cd-9fe5-48ad-b014-195238cb97c4" returned: 0 in 0.391s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-94109e41-46cf-4877-85f3-fc1043f6b02e tempest-VolumesCloneTest-351840439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5c2cc3cd-9fe5-48ad-b014-195238cb97c4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:08 devstack sudo[98848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5c2cc3cd-9fe5-48ad-b014-195238cb97c4 Sep 06 08:12:08 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:09 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38 Sep 06 08:12:09 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:09 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-94109e41-46cf-4877-85f3-fc1043f6b02e tempest-VolumesCloneTest-351840439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5c2cc3cd-9fe5-48ad-b014-195238cb97c4" returned: 0 in 0.291s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:09 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-94109e41-46cf-4877-85f3-fc1043f6b02e tempest-VolumesCloneTest-351840439 None] Lock "cinder-quobyte-5c2cc3cd-9fe5-48ad-b014-195238cb97c4" released by "delete_volume" :: held 0.731s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:09 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-94109e41-46cf-4877-85f3-fc1043f6b02e tempest-VolumesCloneTest-351840439 None] Created reservations ['9a38a350-af9e-4d1d-8562-106c9c894b53', '02b1bb8e-6548-45d8-a4a8-02a0bd4bed76', '69898034-0b73-4797-ae47-8c02b96ac36a', '8aceee96-16b6-417f-9d1a-f1297464f28a'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:12:09 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-14b73c20-cfad-42fe-800e-2a6b3a84e3e0 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38" returned: 0 in 0.422s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-14b73c20-cfad-42fe-800e-2a6b3a84e3e0 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.b1553aa8-0341-4bd1-825e-516f185d7c13 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:09 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.b1553aa8-0341-4bd1-825e-516f185d7c13 1G Sep 06 08:12:09 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-94109e41-46cf-4877-85f3-fc1043f6b02e tempest-VolumesCloneTest-351840439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-94109e41-46cf-4877-85f3-fc1043f6b02e tempest-VolumesCloneTest-351840439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:09 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-94109e41-46cf-4877-85f3-fc1043f6b02e tempest-VolumesCloneTest-351840439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:09 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-94109e41-46cf-4877-85f3-fc1043f6b02e tempest-VolumesCloneTest-351840439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-94109e41-46cf-4877-85f3-fc1043f6b02e tempest-VolumesCloneTest-351840439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-94109e41-46cf-4877-85f3-fc1043f6b02e tempest-VolumesCloneTest-351840439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:09 devstack sudo[98860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:12:09 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:09 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-33b83544-c836-44a8-82ee-b9f41f09c475 tempest-VolumesCloneTest-351840439 None] Acquiring lock "cinder-9e9a7f04-3582-4342-866f-32458ce8deb7-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:09 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-33b83544-c836-44a8-82ee-b9f41f09c475 tempest-VolumesCloneTest-351840439 None] Lock "cinder-9e9a7f04-3582-4342-866f-32458ce8deb7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:09 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-33b83544-c836-44a8-82ee-b9f41f09c475 tempest-VolumesCloneTest-351840439 None] Acquiring lock "cinder-quobyte-9e9a7f04-3582-4342-866f-32458ce8deb7" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:09 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-94109e41-46cf-4877-85f3-fc1043f6b02e tempest-VolumesCloneTest-351840439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.364s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:09 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-94109e41-46cf-4877-85f3-fc1043f6b02e tempest-VolumesCloneTest-351840439 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:12:09 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-33b83544-c836-44a8-82ee-b9f41f09c475 tempest-VolumesCloneTest-351840439 None] Lock "cinder-quobyte-9e9a7f04-3582-4342-866f-32458ce8deb7" acquired by "delete_volume" :: waited 0.030s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:09 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-94109e41-46cf-4877-85f3-fc1043f6b02e tempest-VolumesCloneTest-351840439 None] Deleted volume successfully. Sep 06 08:12:09 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7875d0-b729-4dfe-a4e1-d68eb75ec9ad]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-33b83544-c836-44a8-82ee-b9f41f09c475 tempest-VolumesCloneTest-351840439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:09 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-94109e41-46cf-4877-85f3-fc1043f6b02e tempest-VolumesCloneTest-351840439 None] Lock "cinder-5c2cc3cd-9fe5-48ad-b014-195238cb97c4-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:09 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-14b73c20-cfad-42fe-800e-2a6b3a84e3e0 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.b1553aa8-0341-4bd1-825e-516f185d7c13 1G" returned: 0 in 0.599s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-14b73c20-cfad-42fe-800e-2a6b3a84e3e0 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.b1553aa8-0341-4bd1-825e-516f185d7c13 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:09 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.b1553aa8-0341-4bd1-825e-516f185d7c13 Sep 06 08:12:09 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-5c04ab22-995f-431a-95d8-7efc258c2378 req-901addcd-fcb1-44ab-8ac6-c8d5b528a77e tempest-AttachVolumeTestJSON-589724430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:10 devstack sudo[98875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7 Sep 06 08:12:10 devstack sudo[98875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:10 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-14b73c20-cfad-42fe-800e-2a6b3a84e3e0 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.b1553aa8-0341-4bd1-825e-516f185d7c13" returned: 0 in 0.314s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:10 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-14b73c20-cfad-42fe-800e-2a6b3a84e3e0 tempest-VolumesSnapshotTestJSON-149528372 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.b1553aa8-0341-4bd1-825e-516f185d7c13 is being set with open permissions: ugo+rw Sep 06 08:12:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-14b73c20-cfad-42fe-800e-2a6b3a84e3e0 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.b1553aa8-0341-4bd1-825e-516f185d7c13 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:10 devstack sudo[98875]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-33b83544-c836-44a8-82ee-b9f41f09c475 tempest-VolumesCloneTest-351840439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7" returned: 0 in 0.420s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-33b83544-c836-44a8-82ee-b9f41f09c475 tempest-VolumesCloneTest-351840439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:10 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.b1553aa8-0341-4bd1-825e-516f185d7c13 Sep 06 08:12:10 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:10 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7 Sep 06 08:12:10 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:10 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-14b73c20-cfad-42fe-800e-2a6b3a84e3e0 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.b1553aa8-0341-4bd1-825e-516f185d7c13" returned: 0 in 0.247s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-14b73c20-cfad-42fe-800e-2a6b3a84e3e0 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:10 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-33b83544-c836-44a8-82ee-b9f41f09c475 tempest-VolumesCloneTest-351840439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9e9a7f04-3582-4342-866f-32458ce8deb7" returned: 0 in 0.276s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:10 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.info Sep 06 08:12:10 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-33b83544-c836-44a8-82ee-b9f41f09c475 tempest-VolumesCloneTest-351840439 None] Lock "cinder-quobyte-9e9a7f04-3582-4342-866f-32458ce8deb7" released by "delete_volume" :: held 0.777s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:10 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-33b83544-c836-44a8-82ee-b9f41f09c475 tempest-VolumesCloneTest-351840439 None] Created reservations ['c0ce9a45-dfd9-4229-9a08-a4769f53217c', '10948176-a9c7-48fe-a04f-3273fb93acad', '16b7a6ae-b2a6-4652-a2bd-8efde7794e32', 'e23951a8-c0ba-4953-8e5b-84a96c901198'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:12:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-33b83544-c836-44a8-82ee-b9f41f09c475 tempest-VolumesCloneTest-351840439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-33b83544-c836-44a8-82ee-b9f41f09c475 tempest-VolumesCloneTest-351840439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-33b83544-c836-44a8-82ee-b9f41f09c475 tempest-VolumesCloneTest-351840439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-33b83544-c836-44a8-82ee-b9f41f09c475 tempest-VolumesCloneTest-351840439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-33b83544-c836-44a8-82ee-b9f41f09c475 tempest-VolumesCloneTest-351840439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-33b83544-c836-44a8-82ee-b9f41f09c475 tempest-VolumesCloneTest-351840439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:10 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:12:10 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:10 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-14b73c20-cfad-42fe-800e-2a6b3a84e3e0 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.info" returned: 0 in 0.285s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:10 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-14b73c20-cfad-42fe-800e-2a6b3a84e3e0 tempest-VolumesSnapshotTestJSON-149528372 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.info is being set with open permissions: ugo+rw Sep 06 08:12:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-14b73c20-cfad-42fe-800e-2a6b3a84e3e0 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:10 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.info Sep 06 08:12:10 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:11 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-33b83544-c836-44a8-82ee-b9f41f09c475 tempest-VolumesCloneTest-351840439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.339s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:11 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-33b83544-c836-44a8-82ee-b9f41f09c475 tempest-VolumesCloneTest-351840439 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:12:11 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-33b83544-c836-44a8-82ee-b9f41f09c475 tempest-VolumesCloneTest-351840439 None] Deleted volume successfully. Sep 06 08:12:11 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-33b83544-c836-44a8-82ee-b9f41f09c475 tempest-VolumesCloneTest-351840439 None] Lock "cinder-9e9a7f04-3582-4342-866f-32458ce8deb7-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:11 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-14b73c20-cfad-42fe-800e-2a6b3a84e3e0 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.info" returned: 0 in 0.406s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-14b73c20-cfad-42fe-800e-2a6b3a84e3e0 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.366s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-5c04ab22-995f-431a-95d8-7efc258c2378 req-901addcd-fcb1-44ab-8ac6-c8d5b528a77e tempest-AttachVolumeTestJSON-589724430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.261s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-5c04ab22-995f-431a-95d8-7efc258c2378 req-901addcd-fcb1-44ab-8ac6-c8d5b528a77e tempest-AttachVolumeTestJSON-589724430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:11 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-14b73c20-cfad-42fe-800e-2a6b3a84e3e0 tempest-VolumesSnapshotTestJSON-149528372 None] Create snapshot completed successfully Sep 06 08:12:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-5c04ab22-995f-431a-95d8-7efc258c2378 req-901addcd-fcb1-44ab-8ac6-c8d5b528a77e tempest-AttachVolumeTestJSON-589724430 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0', 'name': 'volume-311534a9-9c1d-4485-87fa-24a3976fbb66', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5e3dfed6-d4a0-424e-8e90-f2225c22390f', 'enforce_multipath': True} {{(pid=87307) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 08:12:11 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-5c04ab22-995f-431a-95d8-7efc258c2378 req-901addcd-fcb1-44ab-8ac6-c8d5b528a77e tempest-AttachVolumeTestJSON-589724430 None] attachment_update completed successfully. Sep 06 08:12:12 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:12:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Flow 'volume_create_manager' (ccf6028c-af3a-4a03-9bd5-cca891899416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (969c4433-8470-4907-895d-ee119c1a32f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (969c4433-8470-4907-895d-ee119c1a32f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1164493367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcbad88a782e408689751fb0f2ce5603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b1553aa8-0341-4bd1-825e-516f185d7c13,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:13Z,use_quota=True,user_id='f5c77449a9bb44b990137b8ec3171970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea56f99f-7895-4b73-8d1b-58d5349e0d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea56f99f-7895-4b73-8d1b-58d5349e0d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2acdbd85-2472-4d46-a159-367ec16b0ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2acdbd85-2472-4d46-a159-367ec16b0ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1', 'volume_name': 'volume-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1', 'volume_size': 1, 'snapshot_id': 'b1553aa8-0341-4bd1-825e-516f185d7c13'}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e03fde0-f2cc-4b65-8172-5271d57d4e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e03fde0-f2cc-4b65-8172-5271d57d4e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80cafc3c-c9d8-42f6-943a-11e4e7e37dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:12 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Volume 0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1', 'volume_size': 1, 'snapshot_id': 'b1553aa8-0341-4bd1-825e-516f185d7c13'} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "cinder-quobyte-b1553aa8-0341-4bd1-825e-516f185d7c13-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1" by "_create_volume_from_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-b1553aa8-0341-4bd1-825e-516f185d7c13-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Creating volume 0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1 from snapshot b1553aa8-0341-4bd1-825e-516f185d7c13 {{(pid=87307) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "cinder-quobyte-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1" by "_copy_volume_from_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] snapshot: b1553aa8-0341-4bd1-825e-516f185d7c13, volume: 0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1, {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12a7352-0645-4003-8267-a4db430c0a6c]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.b1553aa8-0341-4bd1-825e-516f185d7c13 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:13 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.b1553aa8-0341-4bd1-825e-516f185d7c13 Sep 06 08:12:13 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:13 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.b1553aa8-0341-4bd1-825e-516f185d7c13" returned: 0 in 0.396s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21fefc0-529b-4b45-ad97-dae60e6438b0]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:12:13 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38 Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Flow 'volume_create_manager' (8b82ae9e-bbd2-4fed-ae1a-86039deef1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:13 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f79cc9c-367d-4900-92f7-413ec6e05fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f79cc9c-367d-4900-92f7-413ec6e05fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1106017912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73d21ff7-c613-4582-9afc-c6749516d4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9744cd0efc514feb9fbd9c01c7dc5172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:14Z,use_quota=True,user_id='aa6ff475541c4943bced009193f3b662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46d3689-c96a-4a9a-8651-da6dab33e3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46d3689-c96a-4a9a-8651-da6dab33e3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (754c741e-0626-40a6-8935-3f45b89ee29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (754c741e-0626-40a6-8935-3f45b89ee29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73d21ff7-c613-4582-9afc-c6749516d4df', 'volume_name': 'volume-73d21ff7-c613-4582-9afc-c6749516d4df', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a0033df-6931-4eba-ae73-6d827e1c86ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a0033df-6931-4eba-ae73-6d827e1c86ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb7edf9-4ce9-447a-99b6-c1881a3844d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:13 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Volume 73d21ff7-c613-4582-9afc-c6749516d4df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73d21ff7-c613-4582-9afc-c6749516d4df', 'volume_size': 1} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:13 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38" returned: 0 in 0.405s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] will copy from snapshot at /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38 {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Creating direct copy from snapshot {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG cinder.utils [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Path /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1 not found in is_blk_device check {{(pid=87307) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 06 08:12:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:14 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1 Sep 06 08:12:14 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:16 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:12:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Flow 'volume_create_manager' (1aa598c8-c908-4e94-be69-078e483a0677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544913cb-8c22-4022-a7bc-4999ba9f4e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544913cb-8c22-4022-a7bc-4999ba9f4e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1509436878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4efdf4f-4238-40b3-83cc-0039520fa940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56d34b9eaae14c3b805377c5b97108f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:17Z,use_quota=True,user_id='1b43539eab754d919eb769bdad4148d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0bb3c13-41f7-470c-9f9c-7f20ee7e9a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0bb3c13-41f7-470c-9f9c-7f20ee7e9a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90993ba8-e9b6-4c93-8767-01e8a26ed659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90993ba8-e9b6-4c93-8767-01e8a26ed659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4efdf4f-4238-40b3-83cc-0039520fa940', 'volume_name': 'volume-f4efdf4f-4238-40b3-83cc-0039520fa940', 'volume_size': 2}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87a0ee1-9a05-43fa-8ac4-e6f1530e7cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87a0ee1-9a05-43fa-8ac4-e6f1530e7cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1402c4f0-5be1-412d-aaf9-5f9b7ed9f88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:17 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Volume f4efdf4f-4238-40b3-83cc-0039520fa940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4efdf4f-4238-40b3-83cc-0039520fa940', 'volume_size': 2} Sep 06 08:12:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:19 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1" returned: 0 in 5.949s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:19 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Image conversion details: src /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1 {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:12:19 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Converted 1024.00 MB image at 172.11 MB/s Sep 06 08:12:19 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1 is being set with open permissions: ugo+rw Sep 06 08:12:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:19 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1 Sep 06 08:12:19 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:20 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1" returned: 0 in 0.351s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1" released by "_copy_volume_from_snapshot" :: held 7.232s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:20 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-6d2ee449-7f88-4d3b-a553-aba748379aeb req-42650553-3ce2-4783-bd9b-510bad6ffb8f tempest-TestShelveInstance-508546574 None] Terminate volume connection completed successfully. Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-6d2ee449-7f88-4d3b-a553-aba748379aeb req-42650553-3ce2-4783-bd9b-510bad6ffb8f tempest-TestShelveInstance-508546574 None] Deleting attachment 87320824-fe3c-4f4d-a0de-b21055c550aa. {{(pid=87307) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-b1553aa8-0341-4bd1-825e-516f185d7c13-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1" released by "_create_volume_from_snapshot" :: held 7.323s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.344s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.572s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1106017912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73d21ff7-c613-4582-9afc-c6749516d4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9744cd0efc514feb9fbd9c01c7dc5172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:14Z,use_quota=True,user_id='aa6ff475541c4943bced009193f3b662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Creating volume 73d21ff7-c613-4582-9afc-c6749516d4df {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:12:20 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-73d21ff7-c613-4582-9afc-c6749516d4df 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:20 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-73d21ff7-c613-4582-9afc-c6749516d4df 1073741824 Sep 06 08:12:20 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80cafc3c-c9d8-42f6-943a-11e4e7e37dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1', 'volume_size': 1, 'snapshot_id': 'b1553aa8-0341-4bd1-825e-516f185d7c13'}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf9d0d5-a925-406b-b956-375a3f702134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:20 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Volume volume-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1 (0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1): created successfully Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf9d0d5-a925-406b-b956-375a3f702134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Flow 'volume_create_manager' (ccf6028c-af3a-4a03-9bd5-cca891899416) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:20 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e4ad4a08-c899-4a79-8513-a80c3ebaa438 tempest-VolumesSnapshotTestJSON-149528372 None] Created volume successfully. Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-6d2ee449-7f88-4d3b-a553-aba748379aeb req-91985722-4d9e-4da5-8362-07009e6f516f tempest-TestShelveInstance-508546574 None] Acquiring lock "cinder-ec097093-111b-43cf-a782-bef47d4f824c-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-6d2ee449-7f88-4d3b-a553-aba748379aeb req-91985722-4d9e-4da5-8362-07009e6f516f tempest-TestShelveInstance-508546574 None] Lock "cinder-ec097093-111b-43cf-a782-bef47d4f824c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-6d2ee449-7f88-4d3b-a553-aba748379aeb req-91985722-4d9e-4da5-8362-07009e6f516f tempest-TestShelveInstance-508546574 None] Acquiring lock "cinder-quobyte-ec097093-111b-43cf-a782-bef47d4f824c" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-6d2ee449-7f88-4d3b-a553-aba748379aeb req-91985722-4d9e-4da5-8362-07009e6f516f tempest-TestShelveInstance-508546574 None] Lock "cinder-quobyte-ec097093-111b-43cf-a782-bef47d4f824c" acquired by "delete_volume" :: waited 0.025s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e0e5d9-2749-483e-9cec-e0ad8d4e49d5]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-6d2ee449-7f88-4d3b-a553-aba748379aeb req-91985722-4d9e-4da5-8362-07009e6f516f tempest-TestShelveInstance-508546574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ec097093-111b-43cf-a782-bef47d4f824c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:20 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ec097093-111b-43cf-a782-bef47d4f824c Sep 06 08:12:20 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:20 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-73d21ff7-c613-4582-9afc-c6749516d4df 1073741824" returned: 0 in 0.494s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-73d21ff7-c613-4582-9afc-c6749516d4df {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:20 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-73d21ff7-c613-4582-9afc-c6749516d4df Sep 06 08:12:20 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:21 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-6d2ee449-7f88-4d3b-a553-aba748379aeb req-91985722-4d9e-4da5-8362-07009e6f516f tempest-TestShelveInstance-508546574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ec097093-111b-43cf-a782-bef47d4f824c" returned: 0 in 0.465s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-6d2ee449-7f88-4d3b-a553-aba748379aeb req-91985722-4d9e-4da5-8362-07009e6f516f tempest-TestShelveInstance-508546574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ec097093-111b-43cf-a782-bef47d4f824c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-13a9f79e-0042-46fa-b27a-2cdb86df8bc8 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "cinder-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:21 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ec097093-111b-43cf-a782-bef47d4f824c Sep 06 08:12:21 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-13a9f79e-0042-46fa-b27a-2cdb86df8bc8 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-13a9f79e-0042-46fa-b27a-2cdb86df8bc8 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "cinder-quobyte-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-13a9f79e-0042-46fa-b27a-2cdb86df8bc8 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1" acquired by "delete_volume" :: waited 0.019s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[758dbabc-5407-492f-b6e7-126a5a0dbcab]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-13a9f79e-0042-46fa-b27a-2cdb86df8bc8 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:21 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-73d21ff7-c613-4582-9afc-c6749516d4df" returned: 0 in 0.399s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.284s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1509436878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4efdf4f-4238-40b3-83cc-0039520fa940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56d34b9eaae14c3b805377c5b97108f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:17Z,use_quota=True,user_id='1b43539eab754d919eb769bdad4148d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Creating volume f4efdf4f-4238-40b3-83cc-0039520fa940 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:12:21 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940 2147483648 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb7edf9-4ce9-447a-99b6-c1881a3844d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73d21ff7-c613-4582-9afc-c6749516d4df', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce0928c-a213-4946-a611-3ef39d2324c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:21 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940 2147483648 Sep 06 08:12:21 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:21 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Volume volume-73d21ff7-c613-4582-9afc-c6749516d4df (73d21ff7-c613-4582-9afc-c6749516d4df): created successfully Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce0928c-a213-4946-a611-3ef39d2324c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:21 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1 Sep 06 08:12:21 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Flow 'volume_create_manager' (8b82ae9e-bbd2-4fed-ae1a-86039deef1b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:21 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-2ec14863-bae3-4719-b443-74180269ace0 tempest-AttachVolumeTestJSON-589724430 None] Created volume successfully. Sep 06 08:12:21 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-6d2ee449-7f88-4d3b-a553-aba748379aeb req-91985722-4d9e-4da5-8362-07009e6f516f tempest-TestShelveInstance-508546574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ec097093-111b-43cf-a782-bef47d4f824c" returned: 0 in 0.372s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-6d2ee449-7f88-4d3b-a553-aba748379aeb req-91985722-4d9e-4da5-8362-07009e6f516f tempest-TestShelveInstance-508546574 None] Lock "cinder-quobyte-ec097093-111b-43cf-a782-bef47d4f824c" released by "delete_volume" :: held 0.893s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG cinder.quota [req-6d2ee449-7f88-4d3b-a553-aba748379aeb req-91985722-4d9e-4da5-8362-07009e6f516f tempest-TestShelveInstance-508546574 None] Created reservations ['d7e8bc24-9616-4806-a2ec-3ae15aab3835', 'dd4db6d9-5289-4ea1-8ea6-b31e6577c0e7', '51f8b083-c67d-4b9d-a5dd-0fce79ebb521', '1653ebf6-50f2-481a-b94d-f20275ac42ef'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-6d2ee449-7f88-4d3b-a553-aba748379aeb req-91985722-4d9e-4da5-8362-07009e6f516f tempest-TestShelveInstance-508546574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-6d2ee449-7f88-4d3b-a553-aba748379aeb req-91985722-4d9e-4da5-8362-07009e6f516f tempest-TestShelveInstance-508546574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [req-6d2ee449-7f88-4d3b-a553-aba748379aeb req-91985722-4d9e-4da5-8362-07009e6f516f tempest-TestShelveInstance-508546574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [req-6d2ee449-7f88-4d3b-a553-aba748379aeb req-91985722-4d9e-4da5-8362-07009e6f516f tempest-TestShelveInstance-508546574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-6d2ee449-7f88-4d3b-a553-aba748379aeb req-91985722-4d9e-4da5-8362-07009e6f516f tempest-TestShelveInstance-508546574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-6d2ee449-7f88-4d3b-a553-aba748379aeb req-91985722-4d9e-4da5-8362-07009e6f516f tempest-TestShelveInstance-508546574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:21 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:12:21 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:21 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-13a9f79e-0042-46fa-b27a-2cdb86df8bc8 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1" returned: 0 in 0.447s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-13a9f79e-0042-46fa-b27a-2cdb86df8bc8 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:21 devstack sudo[98994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1 Sep 06 08:12:21 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:21 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [req-6d2ee449-7f88-4d3b-a553-aba748379aeb req-91985722-4d9e-4da5-8362-07009e6f516f tempest-TestShelveInstance-508546574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.315s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG cinder.manager [req-6d2ee449-7f88-4d3b-a553-aba748379aeb req-91985722-4d9e-4da5-8362-07009e6f516f tempest-TestShelveInstance-508546574 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:12:21 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-6d2ee449-7f88-4d3b-a553-aba748379aeb req-91985722-4d9e-4da5-8362-07009e6f516f tempest-TestShelveInstance-508546574 None] Deleted volume successfully. Sep 06 08:12:21 devstack cinder-volume[87307]: DEBUG cinder.coordination [req-6d2ee449-7f88-4d3b-a553-aba748379aeb req-91985722-4d9e-4da5-8362-07009e6f516f tempest-TestShelveInstance-508546574 None] Lock "cinder-ec097093-111b-43cf-a782-bef47d4f824c-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:22 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940 2147483648" returned: 0 in 0.721s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:22 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940 Sep 06 08:12:22 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:22 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-13a9f79e-0042-46fa-b27a-2cdb86df8bc8 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1" returned: 0 in 0.448s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:22 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-13a9f79e-0042-46fa-b27a-2cdb86df8bc8 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1" released by "delete_volume" :: held 0.976s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:22 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-13a9f79e-0042-46fa-b27a-2cdb86df8bc8 tempest-VolumesSnapshotTestJSON-149528372 None] Created reservations ['6fb7a0d0-2cdb-40f1-93ad-0ad15924b4e5', '1146b45c-8eea-4ccf-a19d-a0127e490ed8', '841b8d35-a538-4242-94b7-a1e8cec7527b', '33ef307f-6bba-438d-848e-3eba7b6ec6f7'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:12:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-13a9f79e-0042-46fa-b27a-2cdb86df8bc8 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-13a9f79e-0042-46fa-b27a-2cdb86df8bc8 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:22 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-13a9f79e-0042-46fa-b27a-2cdb86df8bc8 tempest-VolumesSnapshotTestJSON-149528372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:22 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-13a9f79e-0042-46fa-b27a-2cdb86df8bc8 tempest-VolumesSnapshotTestJSON-149528372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-13a9f79e-0042-46fa-b27a-2cdb86df8bc8 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-13a9f79e-0042-46fa-b27a-2cdb86df8bc8 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:22 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:12:22 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:22 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940" returned: 0 in 0.373s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:22 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:12:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1402c4f0-5be1-412d-aaf9-5f9b7ed9f88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4efdf4f-4238-40b3-83cc-0039520fa940', 'volume_size': 2}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e9bb2ba-05a1-46f3-bbe8-bba7ad43fd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:22 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Volume volume-f4efdf4f-4238-40b3-83cc-0039520fa940 (f4efdf4f-4238-40b3-83cc-0039520fa940): created successfully Sep 06 08:12:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e9bb2ba-05a1-46f3-bbe8-bba7ad43fd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Flow 'volume_create_manager' (1aa598c8-c908-4e94-be69-078e483a0677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:22 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-94271604-bddd-45a6-83b2-89baa619fb81 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Created volume successfully. Sep 06 08:12:22 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-13a9f79e-0042-46fa-b27a-2cdb86df8bc8 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.297s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:22 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-13a9f79e-0042-46fa-b27a-2cdb86df8bc8 tempest-VolumesSnapshotTestJSON-149528372 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:12:22 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-13a9f79e-0042-46fa-b27a-2cdb86df8bc8 tempest-VolumesSnapshotTestJSON-149528372 None] Deleted volume successfully. Sep 06 08:12:22 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-13a9f79e-0042-46fa-b27a-2cdb86df8bc8 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-0a2721d0-a877-4fbf-a9d9-d3cdc4e553f1-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-55ec60da-70ad-4434-a11f-1274f6ff9447 req-4c013bb7-1f6e-4cf5-b245-7d4f959a1513 tempest-AttachVolumeTestJSON-589724430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-55ec60da-70ad-4434-a11f-1274f6ff9447 req-4c013bb7-1f6e-4cf5-b245-7d4f959a1513 tempest-AttachVolumeTestJSON-589724430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-55ec60da-70ad-4434-a11f-1274f6ff9447 req-4c013bb7-1f6e-4cf5-b245-7d4f959a1513 tempest-AttachVolumeTestJSON-589724430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-55ec60da-70ad-4434-a11f-1274f6ff9447 req-4c013bb7-1f6e-4cf5-b245-7d4f959a1513 tempest-AttachVolumeTestJSON-589724430 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0', 'name': 'volume-73d21ff7-c613-4582-9afc-c6749516d4df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f23ad25-5770-4d25-a0ae-0371f3a522c5', 'enforce_multipath': True} {{(pid=87307) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 08:12:23 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-55ec60da-70ad-4434-a11f-1274f6ff9447 req-4c013bb7-1f6e-4cf5-b245-7d4f959a1513 tempest-AttachVolumeTestJSON-589724430 None] attachment_update completed successfully. Sep 06 08:12:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-12fa084f-cf15-4ccd-96c1-ea8217e745e7 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "cinder-b1553aa8-0341-4bd1-825e-516f185d7c13-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-12fa084f-cf15-4ccd-96c1-ea8217e745e7 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-b1553aa8-0341-4bd1-825e-516f185d7c13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-12fa084f-cf15-4ccd-96c1-ea8217e745e7 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "cinder-quobyte-b8c2c924-f5c5-4131-bc3a-97bb56583e38" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-12fa084f-cf15-4ccd-96c1-ea8217e745e7 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-b8c2c924-f5c5-4131-bc3a-97bb56583e38" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-12fa084f-cf15-4ccd-96c1-ea8217e745e7 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "cinder-quobyte-b1553aa8-0341-4bd1-825e-516f185d7c13" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-12fa084f-cf15-4ccd-96c1-ea8217e745e7 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-b1553aa8-0341-4bd1-825e-516f185d7c13" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-12fa084f-cf15-4ccd-96c1-ea8217e745e7 tempest-VolumesSnapshotTestJSON-149528372 None] Deleting offline snapshot b1553aa8-0341-4bd1-825e-516f185d7c13 of volume b8c2c924-f5c5-4131-bc3a-97bb56583e38 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:12:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-12fa084f-cf15-4ccd-96c1-ea8217e745e7 tempest-VolumesSnapshotTestJSON-149528372 None] snapshot_file for this snap is: volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.b1553aa8-0341-4bd1-825e-516f185d7c13 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:12:23 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe84273-477b-45f5-a290-6ac96087840d]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-12fa084f-cf15-4ccd-96c1-ea8217e745e7 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.b1553aa8-0341-4bd1-825e-516f185d7c13 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e479ccfe-5d1c-4f47-921f-6ee7e91a1b83 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e479ccfe-5d1c-4f47-921f-6ee7e91a1b83 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-e479ccfe-5d1c-4f47-921f-6ee7e91a1b83 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Creating offline snapshot 5779729e-4585-48e5-aa68-e8823b60a4f0 of volume f4efdf4f-4238-40b3-83cc-0039520fa940 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:12:23 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[253b6982-bbec-467f-a12a-a593236d57b8]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e479ccfe-5d1c-4f47-921f-6ee7e91a1b83 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:23 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.b1553aa8-0341-4bd1-825e-516f185d7c13 Sep 06 08:12:23 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:23 devstack sudo[99019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940 Sep 06 08:12:23 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:24 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e479ccfe-5d1c-4f47-921f-6ee7e91a1b83 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940" returned: 0 in 0.450s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e479ccfe-5d1c-4f47-921f-6ee7e91a1b83 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.5779729e-4585-48e5-aa68-e8823b60a4f0 2G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:24 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.5779729e-4585-48e5-aa68-e8823b60a4f0 2G Sep 06 08:12:24 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:24 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-12fa084f-cf15-4ccd-96c1-ea8217e745e7 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.b1553aa8-0341-4bd1-825e-516f185d7c13" returned: 0 in 0.591s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-12fa084f-cf15-4ccd-96c1-ea8217e745e7 tempest-VolumesSnapshotTestJSON-149528372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:12:24 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdeb0b8c-aec2-417c-861f-07c74f7ce3b1]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-12fa084f-cf15-4ccd-96c1-ea8217e745e7 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:24 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38 Sep 06 08:12:24 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:24 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e479ccfe-5d1c-4f47-921f-6ee7e91a1b83 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.5779729e-4585-48e5-aa68-e8823b60a4f0 2G" returned: 0 in 0.561s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e479ccfe-5d1c-4f47-921f-6ee7e91a1b83 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4efdf4f-4238-40b3-83cc-0039520fa940 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.5779729e-4585-48e5-aa68-e8823b60a4f0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:24 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4efdf4f-4238-40b3-83cc-0039520fa940 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.5779729e-4585-48e5-aa68-e8823b60a4f0 Sep 06 08:12:24 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:24 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-12fa084f-cf15-4ccd-96c1-ea8217e745e7 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38" returned: 0 in 0.686s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-12fa084f-cf15-4ccd-96c1-ea8217e745e7 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.b1553aa8-0341-4bd1-825e-516f185d7c13 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:25 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.b1553aa8-0341-4bd1-825e-516f185d7c13 Sep 06 08:12:25 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:25 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e479ccfe-5d1c-4f47-921f-6ee7e91a1b83 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4efdf4f-4238-40b3-83cc-0039520fa940 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.5779729e-4585-48e5-aa68-e8823b60a4f0" returned: 0 in 0.415s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:25 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-e479ccfe-5d1c-4f47-921f-6ee7e91a1b83 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.5779729e-4585-48e5-aa68-e8823b60a4f0 is being set with open permissions: ugo+rw Sep 06 08:12:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e479ccfe-5d1c-4f47-921f-6ee7e91a1b83 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.5779729e-4585-48e5-aa68-e8823b60a4f0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:25 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-c05fb62c-8948-437f-9c2f-80814f69e6d4 req-c17f3e90-bd2c-43a6-ab48-ec86ee003c23 tempest-AttachVolumeTestJSON-589724430 None] Terminate volume connection completed successfully. Sep 06 08:12:25 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-c05fb62c-8948-437f-9c2f-80814f69e6d4 req-c17f3e90-bd2c-43a6-ab48-ec86ee003c23 tempest-AttachVolumeTestJSON-589724430 None] Deleting attachment 5e3dfed6-d4a0-424e-8e90-f2225c22390f. {{(pid=87307) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 08:12:25 devstack sudo[99051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.5779729e-4585-48e5-aa68-e8823b60a4f0 Sep 06 08:12:25 devstack sudo[99051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:25 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-12fa084f-cf15-4ccd-96c1-ea8217e745e7 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.b1553aa8-0341-4bd1-825e-516f185d7c13" returned: 0 in 0.417s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-12fa084f-cf15-4ccd-96c1-ea8217e745e7 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.b1553aa8-0341-4bd1-825e-516f185d7c13 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:25 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.b1553aa8-0341-4bd1-825e-516f185d7c13 Sep 06 08:12:25 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:25 devstack sudo[99051]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e479ccfe-5d1c-4f47-921f-6ee7e91a1b83 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.5779729e-4585-48e5-aa68-e8823b60a4f0" returned: 0 in 0.260s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e479ccfe-5d1c-4f47-921f-6ee7e91a1b83 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:25 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.info Sep 06 08:12:25 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:25 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-12fa084f-cf15-4ccd-96c1-ea8217e745e7 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38.b1553aa8-0341-4bd1-825e-516f185d7c13" returned: 0 in 0.255s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:25 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-12fa084f-cf15-4ccd-96c1-ea8217e745e7 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-b1553aa8-0341-4bd1-825e-516f185d7c13" released by "_delete_snapshot" :: held 2.124s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:25 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-12fa084f-cf15-4ccd-96c1-ea8217e745e7 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-b8c2c924-f5c5-4131-bc3a-97bb56583e38" released by "delete_snapshot" :: held 2.156s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:25 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e479ccfe-5d1c-4f47-921f-6ee7e91a1b83 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.info" returned: 0 in 0.270s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:25 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-e479ccfe-5d1c-4f47-921f-6ee7e91a1b83 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.info is being set with open permissions: ugo+rw Sep 06 08:12:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e479ccfe-5d1c-4f47-921f-6ee7e91a1b83 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:25 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.info Sep 06 08:12:25 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:25 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-12fa084f-cf15-4ccd-96c1-ea8217e745e7 tempest-VolumesSnapshotTestJSON-149528372 None] Created reservations ['cf414968-77b0-4e20-bdea-cf1f1a3871e7', 'c2a74a6d-c71c-40c0-b99b-0fb920d50e7d', '14bc0926-8147-42a6-91ec-30eb67c2c8c9', 'f24309b6-61b3-43a0-8b3a-20deba9a8aa7'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:12:25 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-12fa084f-cf15-4ccd-96c1-ea8217e745e7 tempest-VolumesSnapshotTestJSON-149528372 None] Delete snapshot completed successfully. Sep 06 08:12:25 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-12fa084f-cf15-4ccd-96c1-ea8217e745e7 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-b1553aa8-0341-4bd1-825e-516f185d7c13-delete_snapshot" released by "delete_snapshot" :: held 2.341s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:26 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e479ccfe-5d1c-4f47-921f-6ee7e91a1b83 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.info" returned: 0 in 0.363s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e479ccfe-5d1c-4f47-921f-6ee7e91a1b83 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.464s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:26 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e479ccfe-5d1c-4f47-921f-6ee7e91a1b83 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Create snapshot completed successfully Sep 06 08:12:26 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-3ffc137b-eb84-4f64-9c64-e2aa1fa01e60 req-90872902-56a1-4a07-8c1d-1a080d506dd8 tempest-AttachVolumeTestJSON-589724430 None] Terminate volume connection completed successfully. Sep 06 08:12:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-3ffc137b-eb84-4f64-9c64-e2aa1fa01e60 req-90872902-56a1-4a07-8c1d-1a080d506dd8 tempest-AttachVolumeTestJSON-589724430 None] Deleting attachment 7f23ad25-5770-4d25-a0ae-0371f3a522c5. {{(pid=87307) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 08:12:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a1a0fceb-5b87-4aae-aa72-645f165e5a1c tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "cinder-b8c2c924-f5c5-4131-bc3a-97bb56583e38-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a1a0fceb-5b87-4aae-aa72-645f165e5a1c tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-b8c2c924-f5c5-4131-bc3a-97bb56583e38-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f6a00a42-2568-46d9-8101-6a4d4f6ce9b1 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Acquiring lock "cinder-5779729e-4585-48e5-aa68-e8823b60a4f0-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a1a0fceb-5b87-4aae-aa72-645f165e5a1c tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "cinder-quobyte-b8c2c924-f5c5-4131-bc3a-97bb56583e38" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f6a00a42-2568-46d9-8101-6a4d4f6ce9b1 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Lock "cinder-5779729e-4585-48e5-aa68-e8823b60a4f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f6a00a42-2568-46d9-8101-6a4d4f6ce9b1 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Acquiring lock "cinder-quobyte-f4efdf4f-4238-40b3-83cc-0039520fa940" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a1a0fceb-5b87-4aae-aa72-645f165e5a1c tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-b8c2c924-f5c5-4131-bc3a-97bb56583e38" acquired by "delete_volume" :: waited 0.029s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f6a00a42-2568-46d9-8101-6a4d4f6ce9b1 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Lock "cinder-quobyte-f4efdf4f-4238-40b3-83cc-0039520fa940" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f6a00a42-2568-46d9-8101-6a4d4f6ce9b1 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Acquiring lock "cinder-quobyte-5779729e-4585-48e5-aa68-e8823b60a4f0" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:27 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff60cbd-5841-4c44-a953-dc9fcd6fca4a]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a1a0fceb-5b87-4aae-aa72-645f165e5a1c tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f6a00a42-2568-46d9-8101-6a4d4f6ce9b1 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Lock "cinder-quobyte-5779729e-4585-48e5-aa68-e8823b60a4f0" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f6a00a42-2568-46d9-8101-6a4d4f6ce9b1 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Deleting offline snapshot 5779729e-4585-48e5-aa68-e8823b60a4f0 of volume f4efdf4f-4238-40b3-83cc-0039520fa940 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:12:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f6a00a42-2568-46d9-8101-6a4d4f6ce9b1 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] snapshot_file for this snap is: volume-f4efdf4f-4238-40b3-83cc-0039520fa940.5779729e-4585-48e5-aa68-e8823b60a4f0 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:12:27 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b56ad9-f0b4-4b58-b1ac-67ef8c5aa27b]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f6a00a42-2568-46d9-8101-6a4d4f6ce9b1 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.5779729e-4585-48e5-aa68-e8823b60a4f0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:27 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38 Sep 06 08:12:27 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:27 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.5779729e-4585-48e5-aa68-e8823b60a4f0 Sep 06 08:12:27 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:27 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a1a0fceb-5b87-4aae-aa72-645f165e5a1c tempest-VolumesSnapshotTestJSON-149528372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38" returned: 0 in 0.442s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a1a0fceb-5b87-4aae-aa72-645f165e5a1c tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:27 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38 Sep 06 08:12:27 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:27 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f6a00a42-2568-46d9-8101-6a4d4f6ce9b1 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.5779729e-4585-48e5-aa68-e8823b60a4f0" returned: 0 in 0.477s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f6a00a42-2568-46d9-8101-6a4d4f6ce9b1 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4efdf4f-4238-40b3-83cc-0039520fa940(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:12:27 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[67679f8a-4e00-4f5c-a484-26f969dc822c]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f6a00a42-2568-46d9-8101-6a4d4f6ce9b1 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:27 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940 Sep 06 08:12:27 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:27 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a1a0fceb-5b87-4aae-aa72-645f165e5a1c tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c2c924-f5c5-4131-bc3a-97bb56583e38" returned: 0 in 0.299s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a1a0fceb-5b87-4aae-aa72-645f165e5a1c tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-b8c2c924-f5c5-4131-bc3a-97bb56583e38" released by "delete_volume" :: held 0.829s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:27 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-a1a0fceb-5b87-4aae-aa72-645f165e5a1c tempest-VolumesSnapshotTestJSON-149528372 None] Created reservations ['6d6b6461-43ff-4126-9840-d93fb9c07e0a', '9a438e7c-e3f4-4860-ae65-bd28481be4e1', '0786c2d7-c0b9-4f64-af44-3662d63787c6', 'dcca3969-206c-437b-88d3-4823d59927c9'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:12:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a1a0fceb-5b87-4aae-aa72-645f165e5a1c tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a1a0fceb-5b87-4aae-aa72-645f165e5a1c tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:28 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a1a0fceb-5b87-4aae-aa72-645f165e5a1c tempest-VolumesSnapshotTestJSON-149528372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:28 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a1a0fceb-5b87-4aae-aa72-645f165e5a1c tempest-VolumesSnapshotTestJSON-149528372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a1a0fceb-5b87-4aae-aa72-645f165e5a1c tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a1a0fceb-5b87-4aae-aa72-645f165e5a1c tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:28 devstack sudo[99092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:12:28 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:28 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f6a00a42-2568-46d9-8101-6a4d4f6ce9b1 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940" returned: 0 in 0.577s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f6a00a42-2568-46d9-8101-6a4d4f6ce9b1 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.5779729e-4585-48e5-aa68-e8823b60a4f0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-dd44c4f9-7c3b-4a5b-bc56-3019f5df6f30 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "cinder-94fb7ad4-e97f-41df-a641-6e35defc199e-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:28 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.5779729e-4585-48e5-aa68-e8823b60a4f0 Sep 06 08:12:28 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-dd44c4f9-7c3b-4a5b-bc56-3019f5df6f30 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-94fb7ad4-e97f-41df-a641-6e35defc199e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-dd44c4f9-7c3b-4a5b-bc56-3019f5df6f30 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "cinder-quobyte-94fb7ad4-e97f-41df-a641-6e35defc199e" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-dd44c4f9-7c3b-4a5b-bc56-3019f5df6f30 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-94fb7ad4-e97f-41df-a641-6e35defc199e" acquired by "delete_volume" :: waited 0.060s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:28 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a1a0fceb-5b87-4aae-aa72-645f165e5a1c tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.497s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:28 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-a1a0fceb-5b87-4aae-aa72-645f165e5a1c tempest-VolumesSnapshotTestJSON-149528372 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:12:28 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-a1a0fceb-5b87-4aae-aa72-645f165e5a1c tempest-VolumesSnapshotTestJSON-149528372 None] Deleted volume successfully. Sep 06 08:12:28 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e37316-4058-4764-bb3a-184d676e07c1]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dd44c4f9-7c3b-4a5b-bc56-3019f5df6f30 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a1a0fceb-5b87-4aae-aa72-645f165e5a1c tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-b8c2c924-f5c5-4131-bc3a-97bb56583e38-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:28 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e Sep 06 08:12:28 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:29 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f6a00a42-2568-46d9-8101-6a4d4f6ce9b1 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.5779729e-4585-48e5-aa68-e8823b60a4f0" returned: 0 in 0.815s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f6a00a42-2568-46d9-8101-6a4d4f6ce9b1 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.5779729e-4585-48e5-aa68-e8823b60a4f0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:29 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.5779729e-4585-48e5-aa68-e8823b60a4f0 Sep 06 08:12:29 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:29 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dd44c4f9-7c3b-4a5b-bc56-3019f5df6f30 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e" returned: 0 in 0.525s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dd44c4f9-7c3b-4a5b-bc56-3019f5df6f30 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:29 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e Sep 06 08:12:29 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:29 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dd44c4f9-7c3b-4a5b-bc56-3019f5df6f30 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-94fb7ad4-e97f-41df-a641-6e35defc199e" returned: 0 in 0.298s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:29 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-dd44c4f9-7c3b-4a5b-bc56-3019f5df6f30 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-quobyte-94fb7ad4-e97f-41df-a641-6e35defc199e" released by "delete_volume" :: held 0.998s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f6a00a42-2568-46d9-8101-6a4d4f6ce9b1 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940.5779729e-4585-48e5-aa68-e8823b60a4f0" returned: 0 in 0.436s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f6a00a42-2568-46d9-8101-6a4d4f6ce9b1 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Lock "cinder-quobyte-5779729e-4585-48e5-aa68-e8823b60a4f0" released by "_delete_snapshot" :: held 2.440s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f6a00a42-2568-46d9-8101-6a4d4f6ce9b1 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Lock "cinder-quobyte-f4efdf4f-4238-40b3-83cc-0039520fa940" released by "delete_snapshot" :: held 2.479s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:29 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-dd44c4f9-7c3b-4a5b-bc56-3019f5df6f30 tempest-VolumesSnapshotTestJSON-149528372 None] Created reservations ['50c3d595-ac62-4be4-b10d-0ac601c41d78', 'cddfa83d-823d-4d51-85f1-12372f0df5c2', '30b38f28-c04e-45bf-b2a0-70bc94e06d25', 'b8a8635e-4d9a-4e68-8468-3709f71af9b0'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:12:29 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-f6a00a42-2568-46d9-8101-6a4d4f6ce9b1 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Created reservations ['27bf0f16-ccf2-44a7-8e49-4daf0ec4c5ba', 'bee4ca01-bf54-4008-b965-313f30d6e4f7', '4e914ee1-4dcb-49ca-a831-74f3f9b51f4d', '869a8530-b8c1-4d3f-9d77-1dedcf9ec6cd'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:12:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dd44c4f9-7c3b-4a5b-bc56-3019f5df6f30 tempest-VolumesSnapshotTestJSON-149528372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dd44c4f9-7c3b-4a5b-bc56-3019f5df6f30 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-dd44c4f9-7c3b-4a5b-bc56-3019f5df6f30 tempest-VolumesSnapshotTestJSON-149528372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-dd44c4f9-7c3b-4a5b-bc56-3019f5df6f30 tempest-VolumesSnapshotTestJSON-149528372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dd44c4f9-7c3b-4a5b-bc56-3019f5df6f30 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dd44c4f9-7c3b-4a5b-bc56-3019f5df6f30 tempest-VolumesSnapshotTestJSON-149528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:29 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:12:29 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:29 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f6a00a42-2568-46d9-8101-6a4d4f6ce9b1 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Delete snapshot completed successfully. Sep 06 08:12:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f6a00a42-2568-46d9-8101-6a4d4f6ce9b1 tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Lock "cinder-5779729e-4585-48e5-aa68-e8823b60a4f0-delete_snapshot" released by "delete_snapshot" :: held 2.755s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:29 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dd44c4f9-7c3b-4a5b-bc56-3019f5df6f30 tempest-VolumesSnapshotTestJSON-149528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.304s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:29 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-dd44c4f9-7c3b-4a5b-bc56-3019f5df6f30 tempest-VolumesSnapshotTestJSON-149528372 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:12:30 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-dd44c4f9-7c3b-4a5b-bc56-3019f5df6f30 tempest-VolumesSnapshotTestJSON-149528372 None] Deleted volume successfully. Sep 06 08:12:30 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-dd44c4f9-7c3b-4a5b-bc56-3019f5df6f30 tempest-VolumesSnapshotTestJSON-149528372 None] Lock "cinder-94fb7ad4-e97f-41df-a641-6e35defc199e-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:30 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c5970f73-8d92-4721-bfd5-6ef5dfaad99b tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Acquiring lock "cinder-f4efdf4f-4238-40b3-83cc-0039520fa940-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:30 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c5970f73-8d92-4721-bfd5-6ef5dfaad99b tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Lock "cinder-f4efdf4f-4238-40b3-83cc-0039520fa940-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:30 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c5970f73-8d92-4721-bfd5-6ef5dfaad99b tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Acquiring lock "cinder-quobyte-f4efdf4f-4238-40b3-83cc-0039520fa940" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:30 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c5970f73-8d92-4721-bfd5-6ef5dfaad99b tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Lock "cinder-quobyte-f4efdf4f-4238-40b3-83cc-0039520fa940" acquired by "delete_volume" :: waited 0.029s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:30 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a9c6e7-63c4-4d59-97e3-35fca856f8b2]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c5970f73-8d92-4721-bfd5-6ef5dfaad99b tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:30 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940 Sep 06 08:12:30 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:30 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c5970f73-8d92-4721-bfd5-6ef5dfaad99b tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940" returned: 0 in 0.491s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c5970f73-8d92-4721-bfd5-6ef5dfaad99b tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:30 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940 Sep 06 08:12:30 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:31 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c5970f73-8d92-4721-bfd5-6ef5dfaad99b tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f4efdf4f-4238-40b3-83cc-0039520fa940" returned: 0 in 0.397s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c5970f73-8d92-4721-bfd5-6ef5dfaad99b tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Lock "cinder-quobyte-f4efdf4f-4238-40b3-83cc-0039520fa940" released by "delete_volume" :: held 0.967s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:31 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-c5970f73-8d92-4721-bfd5-6ef5dfaad99b tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Created reservations ['df3d4e2c-695f-45db-a58b-27a2a433161f', '11eaad29-f66f-4344-85a3-498a34aa35df', 'eabd2da7-2d30-47b7-beb1-69749b96ae73', 'b884296b-90ed-4119-8cbf-8b79b3fe06e7'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:12:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c5970f73-8d92-4721-bfd5-6ef5dfaad99b tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c5970f73-8d92-4721-bfd5-6ef5dfaad99b tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c5970f73-8d92-4721-bfd5-6ef5dfaad99b tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c5970f73-8d92-4721-bfd5-6ef5dfaad99b tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c5970f73-8d92-4721-bfd5-6ef5dfaad99b tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c5970f73-8d92-4721-bfd5-6ef5dfaad99b tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:31 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:12:31 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:31 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c5970f73-8d92-4721-bfd5-6ef5dfaad99b tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.263s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:31 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-c5970f73-8d92-4721-bfd5-6ef5dfaad99b tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:12:31 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-c5970f73-8d92-4721-bfd5-6ef5dfaad99b tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Deleted volume successfully. Sep 06 08:12:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c5970f73-8d92-4721-bfd5-6ef5dfaad99b tempest-VolumesSnapshotNegativeTestJSON-1478890350 None] Lock "cinder-f4efdf4f-4238-40b3-83cc-0039520fa940-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:34 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3a36622b-cf34-4fb4-87cd-e69760663f6a tempest-AttachVolumeTestJSON-589724430 None] Acquiring lock "cinder-73d21ff7-c613-4582-9afc-c6749516d4df-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:34 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3a36622b-cf34-4fb4-87cd-e69760663f6a tempest-AttachVolumeTestJSON-589724430 None] Lock "cinder-73d21ff7-c613-4582-9afc-c6749516d4df-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:34 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3a36622b-cf34-4fb4-87cd-e69760663f6a tempest-AttachVolumeTestJSON-589724430 None] Acquiring lock "cinder-quobyte-73d21ff7-c613-4582-9afc-c6749516d4df" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:34 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3a36622b-cf34-4fb4-87cd-e69760663f6a tempest-AttachVolumeTestJSON-589724430 None] Lock "cinder-quobyte-73d21ff7-c613-4582-9afc-c6749516d4df" acquired by "delete_volume" :: waited 0.028s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:34 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f18d7b9-ca62-400b-abac-a23574cb0dcf]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3a36622b-cf34-4fb4-87cd-e69760663f6a tempest-AttachVolumeTestJSON-589724430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-73d21ff7-c613-4582-9afc-c6749516d4df {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:34 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-73d21ff7-c613-4582-9afc-c6749516d4df Sep 06 08:12:34 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:34 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3a36622b-cf34-4fb4-87cd-e69760663f6a tempest-AttachVolumeTestJSON-589724430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-73d21ff7-c613-4582-9afc-c6749516d4df" returned: 0 in 0.381s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3a36622b-cf34-4fb4-87cd-e69760663f6a tempest-AttachVolumeTestJSON-589724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-73d21ff7-c613-4582-9afc-c6749516d4df {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:34 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-73d21ff7-c613-4582-9afc-c6749516d4df Sep 06 08:12:34 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:34 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3a36622b-cf34-4fb4-87cd-e69760663f6a tempest-AttachVolumeTestJSON-589724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-73d21ff7-c613-4582-9afc-c6749516d4df" returned: 0 in 0.310s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:34 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3a36622b-cf34-4fb4-87cd-e69760663f6a tempest-AttachVolumeTestJSON-589724430 None] Lock "cinder-quobyte-73d21ff7-c613-4582-9afc-c6749516d4df" released by "delete_volume" :: held 0.762s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:35 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-3a36622b-cf34-4fb4-87cd-e69760663f6a tempest-AttachVolumeTestJSON-589724430 None] Created reservations ['37a8a099-17b4-4a55-9c9d-8e00a86ac67d', 'e20917c6-6e13-4b6b-9b69-bbe6a5ae4824', '2c90df5a-924d-4b9f-a6bd-d52e39ea5ba9', 'e92b2eca-7774-4efd-8674-5a1564269ba6'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:12:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3a36622b-cf34-4fb4-87cd-e69760663f6a tempest-AttachVolumeTestJSON-589724430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3a36622b-cf34-4fb4-87cd-e69760663f6a tempest-AttachVolumeTestJSON-589724430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3a36622b-cf34-4fb4-87cd-e69760663f6a tempest-AttachVolumeTestJSON-589724430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3a36622b-cf34-4fb4-87cd-e69760663f6a tempest-AttachVolumeTestJSON-589724430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3a36622b-cf34-4fb4-87cd-e69760663f6a tempest-AttachVolumeTestJSON-589724430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3a36622b-cf34-4fb4-87cd-e69760663f6a tempest-AttachVolumeTestJSON-589724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:35 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:12:35 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:35 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ddefca2-b741-4790-b4c2-64ab819e8554 tempest-AttachVolumeTestJSON-589724430 None] Acquiring lock "cinder-311534a9-9c1d-4485-87fa-24a3976fbb66-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:35 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ddefca2-b741-4790-b4c2-64ab819e8554 tempest-AttachVolumeTestJSON-589724430 None] Lock "cinder-311534a9-9c1d-4485-87fa-24a3976fbb66-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:35 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ddefca2-b741-4790-b4c2-64ab819e8554 tempest-AttachVolumeTestJSON-589724430 None] Acquiring lock "cinder-quobyte-311534a9-9c1d-4485-87fa-24a3976fbb66" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:35 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ddefca2-b741-4790-b4c2-64ab819e8554 tempest-AttachVolumeTestJSON-589724430 None] Lock "cinder-quobyte-311534a9-9c1d-4485-87fa-24a3976fbb66" acquired by "delete_volume" :: waited 0.024s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:35 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[872ef1fa-bb7e-4b3e-9a91-3d64257f8dca]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ddefca2-b741-4790-b4c2-64ab819e8554 tempest-AttachVolumeTestJSON-589724430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-311534a9-9c1d-4485-87fa-24a3976fbb66 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:35 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3a36622b-cf34-4fb4-87cd-e69760663f6a tempest-AttachVolumeTestJSON-589724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.452s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:35 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-3a36622b-cf34-4fb4-87cd-e69760663f6a tempest-AttachVolumeTestJSON-589724430 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:12:35 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-3a36622b-cf34-4fb4-87cd-e69760663f6a tempest-AttachVolumeTestJSON-589724430 None] Deleted volume successfully. Sep 06 08:12:35 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3a36622b-cf34-4fb4-87cd-e69760663f6a tempest-AttachVolumeTestJSON-589724430 None] Lock "cinder-73d21ff7-c613-4582-9afc-c6749516d4df-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:35 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-311534a9-9c1d-4485-87fa-24a3976fbb66 Sep 06 08:12:35 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:36 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ddefca2-b741-4790-b4c2-64ab819e8554 tempest-AttachVolumeTestJSON-589724430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-311534a9-9c1d-4485-87fa-24a3976fbb66" returned: 0 in 0.524s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ddefca2-b741-4790-b4c2-64ab819e8554 tempest-AttachVolumeTestJSON-589724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-311534a9-9c1d-4485-87fa-24a3976fbb66 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:36 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-311534a9-9c1d-4485-87fa-24a3976fbb66 Sep 06 08:12:36 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:36 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ddefca2-b741-4790-b4c2-64ab819e8554 tempest-AttachVolumeTestJSON-589724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-311534a9-9c1d-4485-87fa-24a3976fbb66" returned: 0 in 0.326s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:36 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ddefca2-b741-4790-b4c2-64ab819e8554 tempest-AttachVolumeTestJSON-589724430 None] Lock "cinder-quobyte-311534a9-9c1d-4485-87fa-24a3976fbb66" released by "delete_volume" :: held 0.924s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:36 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-0ddefca2-b741-4790-b4c2-64ab819e8554 tempest-AttachVolumeTestJSON-589724430 None] Created reservations ['15e2b8c4-413d-4012-bb7c-20bee57b4641', '6d5ab814-5814-4566-a9d3-a8aa4df58846', 'eedf0372-b284-4c4a-8546-0354be1a0880', '7f2fde59-81f3-4eb7-8cf4-569c70fefb89'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:12:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0ddefca2-b741-4790-b4c2-64ab819e8554 tempest-AttachVolumeTestJSON-589724430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0ddefca2-b741-4790-b4c2-64ab819e8554 tempest-AttachVolumeTestJSON-589724430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:36 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0ddefca2-b741-4790-b4c2-64ab819e8554 tempest-AttachVolumeTestJSON-589724430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:36 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0ddefca2-b741-4790-b4c2-64ab819e8554 tempest-AttachVolumeTestJSON-589724430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0ddefca2-b741-4790-b4c2-64ab819e8554 tempest-AttachVolumeTestJSON-589724430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ddefca2-b741-4790-b4c2-64ab819e8554 tempest-AttachVolumeTestJSON-589724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:36 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:12:36 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:36 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ddefca2-b741-4790-b4c2-64ab819e8554 tempest-AttachVolumeTestJSON-589724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.283s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:36 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-0ddefca2-b741-4790-b4c2-64ab819e8554 tempest-AttachVolumeTestJSON-589724430 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:12:37 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-0ddefca2-b741-4790-b4c2-64ab819e8554 tempest-AttachVolumeTestJSON-589724430 None] Deleted volume successfully. Sep 06 08:12:37 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ddefca2-b741-4790-b4c2-64ab819e8554 tempest-AttachVolumeTestJSON-589724430 None] Lock "cinder-311534a9-9c1d-4485-87fa-24a3976fbb66-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:37 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a2dde65a-6351-4cd0-84d7-935c9a5d3ae1 tempest-AttachVolumeTestJSON-589724430 None] Acquiring lock "cinder-f393d507-c01e-4301-9e45-30759269421c-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:37 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a2dde65a-6351-4cd0-84d7-935c9a5d3ae1 tempest-AttachVolumeTestJSON-589724430 None] Lock "cinder-f393d507-c01e-4301-9e45-30759269421c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:37 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a2dde65a-6351-4cd0-84d7-935c9a5d3ae1 tempest-AttachVolumeTestJSON-589724430 None] Acquiring lock "cinder-quobyte-f393d507-c01e-4301-9e45-30759269421c" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:37 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a2dde65a-6351-4cd0-84d7-935c9a5d3ae1 tempest-AttachVolumeTestJSON-589724430 None] Lock "cinder-quobyte-f393d507-c01e-4301-9e45-30759269421c" acquired by "delete_volume" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:37 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc98ab7-0557-4ba1-8198-ace5f940b0ac]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a2dde65a-6351-4cd0-84d7-935c9a5d3ae1 tempest-AttachVolumeTestJSON-589724430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f393d507-c01e-4301-9e45-30759269421c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:38 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f393d507-c01e-4301-9e45-30759269421c Sep 06 08:12:38 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:38 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a2dde65a-6351-4cd0-84d7-935c9a5d3ae1 tempest-AttachVolumeTestJSON-589724430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f393d507-c01e-4301-9e45-30759269421c" returned: 0 in 0.474s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a2dde65a-6351-4cd0-84d7-935c9a5d3ae1 tempest-AttachVolumeTestJSON-589724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f393d507-c01e-4301-9e45-30759269421c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:38 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f393d507-c01e-4301-9e45-30759269421c Sep 06 08:12:38 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:38 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a2dde65a-6351-4cd0-84d7-935c9a5d3ae1 tempest-AttachVolumeTestJSON-589724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f393d507-c01e-4301-9e45-30759269421c" returned: 0 in 0.434s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a2dde65a-6351-4cd0-84d7-935c9a5d3ae1 tempest-AttachVolumeTestJSON-589724430 None] Lock "cinder-quobyte-f393d507-c01e-4301-9e45-30759269421c" released by "delete_volume" :: held 0.998s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:38 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Flow 'volume_create_manager' (9abd7424-6e65-481e-8c0a-94796f119862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0701d52-b280-42b0-9505-e65d3b509f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0701d52-b280-42b0-9505-e65d3b509f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1544149594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffd571e8-e95c-4008-a70c-c0d2bfa9f475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286fafe7d88b4f49a79fd5ad0212c119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:39Z,use_quota=True,user_id='13d3dcad2a9f4968afb2cc1cc01e8058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eb66ba8-4ffe-4789-b4c5-554149f7970c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eb66ba8-4ffe-4789-b4c5-554149f7970c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8b50a6-ac6c-42a2-ae7f-988aa3d98514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8b50a6-ac6c-42a2-ae7f-988aa3d98514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffd571e8-e95c-4008-a70c-c0d2bfa9f475', 'volume_name': 'volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afccf6df-5faa-4b5e-96d3-01326f28c707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afccf6df-5faa-4b5e-96d3-01326f28c707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd50a855-5fbb-4330-977f-8d849510ec6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:39 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Volume ffd571e8-e95c-4008-a70c-c0d2bfa9f475: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475', 'volume_size': 1} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1544149594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffd571e8-e95c-4008-a70c-c0d2bfa9f475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286fafe7d88b4f49a79fd5ad0212c119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:39Z,use_quota=True,user_id='13d3dcad2a9f4968afb2cc1cc01e8058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Creating volume ffd571e8-e95c-4008-a70c-c0d2bfa9f475 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:12:39 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:39 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475 1073741824 Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-a2dde65a-6351-4cd0-84d7-935c9a5d3ae1 tempest-AttachVolumeTestJSON-589724430 None] Created reservations ['de6d05d0-5e1f-432b-bea7-23414aff15f6', '00522d48-5071-4ff9-9c22-d5b53279c783', 'd8ee4062-ade1-4e83-95ab-b3249900f779', '793b6aa6-f4f9-4a32-a91a-23406507955a'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:12:39 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a2dde65a-6351-4cd0-84d7-935c9a5d3ae1 tempest-AttachVolumeTestJSON-589724430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a2dde65a-6351-4cd0-84d7-935c9a5d3ae1 tempest-AttachVolumeTestJSON-589724430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a2dde65a-6351-4cd0-84d7-935c9a5d3ae1 tempest-AttachVolumeTestJSON-589724430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a2dde65a-6351-4cd0-84d7-935c9a5d3ae1 tempest-AttachVolumeTestJSON-589724430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a2dde65a-6351-4cd0-84d7-935c9a5d3ae1 tempest-AttachVolumeTestJSON-589724430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a2dde65a-6351-4cd0-84d7-935c9a5d3ae1 tempest-AttachVolumeTestJSON-589724430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:39 devstack sudo[99186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:12:39 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:39 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a2dde65a-6351-4cd0-84d7-935c9a5d3ae1 tempest-AttachVolumeTestJSON-589724430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.349s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-a2dde65a-6351-4cd0-84d7-935c9a5d3ae1 tempest-AttachVolumeTestJSON-589724430 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:12:39 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-a2dde65a-6351-4cd0-84d7-935c9a5d3ae1 tempest-AttachVolumeTestJSON-589724430 None] Deleted volume successfully. Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a2dde65a-6351-4cd0-84d7-935c9a5d3ae1 tempest-AttachVolumeTestJSON-589724430 None] Lock "cinder-f393d507-c01e-4301-9e45-30759269421c-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:39 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475 1073741824" returned: 0 in 0.595s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:39 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475 Sep 06 08:12:39 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:40 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475" returned: 0 in 0.278s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd50a855-5fbb-4330-977f-8d849510ec6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66f136b0-a2a6-4621-a85f-59431cc80320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:40 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Volume volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475 (ffd571e8-e95c-4008-a70c-c0d2bfa9f475): created successfully Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66f136b0-a2a6-4621-a85f-59431cc80320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Flow 'volume_create_manager' (9abd7424-6e65-481e-8c0a-94796f119862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:40 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-b5e14db5-08d7-493c-b062-a1cfb4200d2a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Created volume successfully. Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Flow 'volume_create_manager' (5bd4667f-5e7f-43ad-bd76-2b9f304092a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd3ba171-980b-42c0-ad77-d4c64f533326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd3ba171-980b-42c0-ad77-d4c64f533326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1708156464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ce06588-50c0-4e5d-a664-7b15015920c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34ee11971e34a8494e34a44e6e803fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:41Z,use_quota=True,user_id='45d61e4af9a847ebaef8b493706989cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b85e3b-055b-4c59-80b9-c1813773903a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b85e3b-055b-4c59-80b9-c1813773903a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f597afc5-8379-4b48-9381-8ba032cb3c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f597afc5-8379-4b48-9381-8ba032cb3c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ce06588-50c0-4e5d-a664-7b15015920c9', 'volume_name': 'volume-2ce06588-50c0-4e5d-a664-7b15015920c9', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a73dcbe-5bcf-4383-9ce6-b38a3fc4d37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a73dcbe-5bcf-4383-9ce6-b38a3fc4d37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b385806-4f55-49ec-8216-f5242a8e2325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:40 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Volume 2ce06588-50c0-4e5d-a664-7b15015920c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ce06588-50c0-4e5d-a664-7b15015920c9', 'volume_size': 1} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1708156464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ce06588-50c0-4e5d-a664-7b15015920c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34ee11971e34a8494e34a44e6e803fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:41Z,use_quota=True,user_id='45d61e4af9a847ebaef8b493706989cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Creating volume 2ce06588-50c0-4e5d-a664-7b15015920c9 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:12:40 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:12:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:40 devstack sudo[99196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9 1073741824 Sep 06 08:12:40 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:41 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9 1073741824" returned: 0 in 0.639s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d86d3505-cda7-4d34-8b4c-a2ea91f3ae5a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:41 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9 Sep 06 08:12:41 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:41 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9" returned: 0 in 0.309s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:12:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d86d3505-cda7-4d34-8b4c-a2ea91f3ae5a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.344s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b385806-4f55-49ec-8216-f5242a8e2325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ce06588-50c0-4e5d-a664-7b15015920c9', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11cf8c41-2f92-44f6-a1b5-c627a5697281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-d86d3505-cda7-4d34-8b4c-a2ea91f3ae5a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Creating offline snapshot 5d12d15f-db1d-4504-adb7-ae6d580c4bf4 of volume ffd571e8-e95c-4008-a70c-c0d2bfa9f475 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:12:41 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Volume volume-2ce06588-50c0-4e5d-a664-7b15015920c9 (2ce06588-50c0-4e5d-a664-7b15015920c9): created successfully Sep 06 08:12:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11cf8c41-2f92-44f6-a1b5-c627a5697281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Flow 'volume_create_manager' (5bd4667f-5e7f-43ad-bd76-2b9f304092a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:41 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[756d0b96-b307-4f51-a4b3-829cc48ae052]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d86d3505-cda7-4d34-8b4c-a2ea91f3ae5a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:41 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-51a32b7d-efb7-4c12-8083-af8bcd1ac4dc tempest-VolumesSnapshotListTestJSON-1139688237 None] Created volume successfully. Sep 06 08:12:41 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475 Sep 06 08:12:41 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:42 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d86d3505-cda7-4d34-8b4c-a2ea91f3ae5a tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475" returned: 0 in 0.429s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d86d3505-cda7-4d34-8b4c-a2ea91f3ae5a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.5d12d15f-db1d-4504-adb7-ae6d580c4bf4 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:42 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.5d12d15f-db1d-4504-adb7-ae6d580c4bf4 1G Sep 06 08:12:42 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:42 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d86d3505-cda7-4d34-8b4c-a2ea91f3ae5a tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.5d12d15f-db1d-4504-adb7-ae6d580c4bf4 1G" returned: 0 in 0.593s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d86d3505-cda7-4d34-8b4c-a2ea91f3ae5a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.5d12d15f-db1d-4504-adb7-ae6d580c4bf4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:42 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.5d12d15f-db1d-4504-adb7-ae6d580c4bf4 Sep 06 08:12:42 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6ed217d5-7374-4446-bbd9-09d0a1664e10 tempest-VolumesSnapshotListTestJSON-1139688237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:43 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d86d3505-cda7-4d34-8b4c-a2ea91f3ae5a tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.5d12d15f-db1d-4504-adb7-ae6d580c4bf4" returned: 0 in 0.389s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:43 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-d86d3505-cda7-4d34-8b4c-a2ea91f3ae5a tempest-CreateVolumesFromSnapshotTest-1396099469 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.5d12d15f-db1d-4504-adb7-ae6d580c4bf4 is being set with open permissions: ugo+rw Sep 06 08:12:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d86d3505-cda7-4d34-8b4c-a2ea91f3ae5a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.5d12d15f-db1d-4504-adb7-ae6d580c4bf4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:43 devstack sudo[99223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.5d12d15f-db1d-4504-adb7-ae6d580c4bf4 Sep 06 08:12:43 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:43 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d86d3505-cda7-4d34-8b4c-a2ea91f3ae5a tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.5d12d15f-db1d-4504-adb7-ae6d580c4bf4" returned: 0 in 0.307s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d86d3505-cda7-4d34-8b4c-a2ea91f3ae5a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:43 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.info Sep 06 08:12:43 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:43 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d86d3505-cda7-4d34-8b4c-a2ea91f3ae5a tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.info" returned: 0 in 0.307s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:43 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-d86d3505-cda7-4d34-8b4c-a2ea91f3ae5a tempest-CreateVolumesFromSnapshotTest-1396099469 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.info is being set with open permissions: ugo+rw Sep 06 08:12:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d86d3505-cda7-4d34-8b4c-a2ea91f3ae5a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:43 devstack sudo[99229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.info Sep 06 08:12:43 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:44 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d86d3505-cda7-4d34-8b4c-a2ea91f3ae5a tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.info" returned: 0 in 0.252s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d86d3505-cda7-4d34-8b4c-a2ea91f3ae5a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.412s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6ed217d5-7374-4446-bbd9-09d0a1664e10 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.088s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:44 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-6ed217d5-7374-4446-bbd9-09d0a1664e10 tempest-VolumesSnapshotListTestJSON-1139688237 None] Creating offline snapshot 7f69537c-5a23-455b-9df4-ea9402187bb6 of volume 2ce06588-50c0-4e5d-a664-7b15015920c9 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:12:44 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-d86d3505-cda7-4d34-8b4c-a2ea91f3ae5a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Create snapshot completed successfully Sep 06 08:12:44 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f885bf9-6d6e-4f34-8d3f-5cf22d5ac964]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6ed217d5-7374-4446-bbd9-09d0a1664e10 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:44 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9 Sep 06 08:12:44 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:44 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6ed217d5-7374-4446-bbd9-09d0a1664e10 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9" returned: 0 in 0.536s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6ed217d5-7374-4446-bbd9-09d0a1664e10 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:44 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6 1G Sep 06 08:12:44 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:45 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:12:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Flow 'volume_create_manager' (eca6ecf0-10ac-40bc-9fca-6943533d0ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd222ee-f2cf-40d9-b6ec-393f39e7b250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd222ee-f2cf-40d9-b6ec-393f39e7b250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-659155260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75aa8813-91d5-4730-b2f1-622cc5454f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286fafe7d88b4f49a79fd5ad0212c119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:45Z,use_quota=True,user_id='13d3dcad2a9f4968afb2cc1cc01e8058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf87e97-3a5e-49fd-8f63-5b5a3637d77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf87e97-3a5e-49fd-8f63-5b5a3637d77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5791973b-59b6-4340-9e92-c49b5d0267f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5791973b-59b6-4340-9e92-c49b5d0267f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75aa8813-91d5-4730-b2f1-622cc5454f22', 'volume_name': 'volume-75aa8813-91d5-4730-b2f1-622cc5454f22', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9dcfeb0-6396-408e-9579-2da3c948537a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9dcfeb0-6396-408e-9579-2da3c948537a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3604e8ee-7cb0-45c7-8e2c-cbf556092d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:45 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:45 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Volume 75aa8813-91d5-4730-b2f1-622cc5454f22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75aa8813-91d5-4730-b2f1-622cc5454f22', 'volume_size': 1} Sep 06 08:12:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6ed217d5-7374-4446-bbd9-09d0a1664e10 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6 1G" returned: 0 in 0.667s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6ed217d5-7374-4446-bbd9-09d0a1664e10 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ce06588-50c0-4e5d-a664-7b15015920c9 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:45 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ce06588-50c0-4e5d-a664-7b15015920c9 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6 Sep 06 08:12:45 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:45 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6ed217d5-7374-4446-bbd9-09d0a1664e10 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ce06588-50c0-4e5d-a664-7b15015920c9 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6" returned: 0 in 0.419s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:45 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-6ed217d5-7374-4446-bbd9-09d0a1664e10 tempest-VolumesSnapshotListTestJSON-1139688237 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6 is being set with open permissions: ugo+rw Sep 06 08:12:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6ed217d5-7374-4446-bbd9-09d0a1664e10 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:45 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6 Sep 06 08:12:45 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Flow 'volume_create_manager' (06f249c9-12a4-4fe4-a904-e09ed1e6d4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b86314-f2c2-4c74-8db3-e4dfaeec6600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b86314-f2c2-4c74-8db3-e4dfaeec6600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-761906707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b5c542-405c-462d-8bb0-e479d38d536e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286fafe7d88b4f49a79fd5ad0212c119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:46Z,use_quota=True,user_id='13d3dcad2a9f4968afb2cc1cc01e8058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83316fc-e5ba-4b95-ad92-e43915041179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83316fc-e5ba-4b95-ad92-e43915041179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfa0d98-1bb2-41ad-bf42-c15de7bce731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfa0d98-1bb2-41ad-bf42-c15de7bce731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17b5c542-405c-462d-8bb0-e479d38d536e', 'volume_name': 'volume-17b5c542-405c-462d-8bb0-e479d38d536e', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (720ce9e3-4034-489a-aea5-ff72a5e34321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (720ce9e3-4034-489a-aea5-ff72a5e34321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe421b1-b0d8-41ff-95b7-fd6580952830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:46 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Volume 17b5c542-405c-462d-8bb0-e479d38d536e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17b5c542-405c-462d-8bb0-e479d38d536e', 'volume_size': 1} Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:46 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6ed217d5-7374-4446-bbd9-09d0a1664e10 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6" returned: 0 in 0.495s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6ed217d5-7374-4446-bbd9-09d0a1664e10 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:46 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.info Sep 06 08:12:46 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Flow 'volume_create_manager' (b60b88cb-9a9a-454e-9531-6fa68f119ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df5eeb4-51ba-44af-9c35-b88cb78906f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df5eeb4-51ba-44af-9c35-b88cb78906f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-889079999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286fafe7d88b4f49a79fd5ad0212c119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:47Z,use_quota=True,user_id='13d3dcad2a9f4968afb2cc1cc01e8058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e7b5647-cb78-47cd-bc73-d5c5324db9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e7b5647-cb78-47cd-bc73-d5c5324db9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf30494a-16a8-42e9-a5b0-3d6abd8f110c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf30494a-16a8-42e9-a5b0-3d6abd8f110c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3', 'volume_name': 'volume-fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23dba21-1614-44db-b97c-ef2fd6c8c46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23dba21-1614-44db-b97c-ef2fd6c8c46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9084d03c-31e3-4890-b0e6-cb0c3fa915ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:46 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Volume fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3', 'volume_size': 1} Sep 06 08:12:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:47 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6ed217d5-7374-4446-bbd9-09d0a1664e10 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.info" returned: 0 in 0.646s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:47 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-6ed217d5-7374-4446-bbd9-09d0a1664e10 tempest-VolumesSnapshotListTestJSON-1139688237 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.info is being set with open permissions: ugo+rw Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6ed217d5-7374-4446-bbd9-09d0a1664e10 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:47 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.info Sep 06 08:12:47 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Flow 'volume_create_manager' (5370b48f-a4ab-4616-9d64-2546bbaff8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4597fea-bb7f-4d3b-b113-00f58b2f4ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4597fea-bb7f-4d3b-b113-00f58b2f4ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-105798928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c4f937-e5ab-46e9-97c7-1937599853cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286fafe7d88b4f49a79fd5ad0212c119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:47Z,use_quota=True,user_id='13d3dcad2a9f4968afb2cc1cc01e8058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2acb0adb-bb09-4179-a0a9-615b24e57d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2acb0adb-bb09-4179-a0a9-615b24e57d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617d6abe-c189-4acf-8259-ec2b5e3f3d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617d6abe-c189-4acf-8259-ec2b5e3f3d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46c4f937-e5ab-46e9-97c7-1937599853cf', 'volume_name': 'volume-46c4f937-e5ab-46e9-97c7-1937599853cf', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d16bb6f-0379-4edb-b249-59820c491c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d16bb6f-0379-4edb-b249-59820c491c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8a155c-401a-4898-b633-f5bdefbec344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:47 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Volume 46c4f937-e5ab-46e9-97c7-1937599853cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46c4f937-e5ab-46e9-97c7-1937599853cf', 'volume_size': 1} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:47 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6ed217d5-7374-4446-bbd9-09d0a1664e10 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.info" returned: 0 in 0.489s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6ed217d5-7374-4446-bbd9-09d0a1664e10 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.440s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.187s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-659155260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75aa8813-91d5-4730-b2f1-622cc5454f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286fafe7d88b4f49a79fd5ad0212c119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:45Z,use_quota=True,user_id='13d3dcad2a9f4968afb2cc1cc01e8058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Creating volume 75aa8813-91d5-4730-b2f1-622cc5454f22 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:12:47 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-75aa8813-91d5-4730-b2f1-622cc5454f22 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:47 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-75aa8813-91d5-4730-b2f1-622cc5454f22 1073741824 Sep 06 08:12:47 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:47 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-6ed217d5-7374-4446-bbd9-09d0a1664e10 tempest-VolumesSnapshotListTestJSON-1139688237 None] Create snapshot completed successfully Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Flow 'volume_create_manager' (b153fb08-4e1d-4ad6-b186-96ce3cf4d115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d084b3fe-9196-4b6a-8054-8cb02afaef1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d084b3fe-9196-4b6a-8054-8cb02afaef1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1803482866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67b9b9e-4ab1-4519-8080-fdda3ad94bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286fafe7d88b4f49a79fd5ad0212c119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:48Z,use_quota=True,user_id='13d3dcad2a9f4968afb2cc1cc01e8058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9738bd-da6f-4067-a895-494a78885d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9738bd-da6f-4067-a895-494a78885d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53a73a1-72d8-4d85-a587-014705483dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53a73a1-72d8-4d85-a587-014705483dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c67b9b9e-4ab1-4519-8080-fdda3ad94bb9', 'volume_name': 'volume-c67b9b9e-4ab1-4519-8080-fdda3ad94bb9', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5616ae-1ad6-4f7e-bf03-e10b0958955a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5616ae-1ad6-4f7e-bf03-e10b0958955a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb995fa-0c54-4ca4-be79-6b6b27ab62af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:47 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Volume c67b9b9e-4ab1-4519-8080-fdda3ad94bb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c67b9b9e-4ab1-4519-8080-fdda3ad94bb9', 'volume_size': 1} Sep 06 08:12:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:48 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-75aa8813-91d5-4730-b2f1-622cc5454f22 1073741824" returned: 0 in 0.721s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-75aa8813-91d5-4730-b2f1-622cc5454f22 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:48 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-75aa8813-91d5-4730-b2f1-622cc5454f22 Sep 06 08:12:48 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0e0da7dd-0dc8-453c-93a7-7ead0c95cfc2 tempest-VolumesSnapshotListTestJSON-1139688237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:48 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-75aa8813-91d5-4730-b2f1-622cc5454f22" returned: 0 in 0.432s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:48 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:12:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.627s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:48 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-761906707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b5c542-405c-462d-8bb0-e479d38d536e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286fafe7d88b4f49a79fd5ad0212c119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:46Z,use_quota=True,user_id='13d3dcad2a9f4968afb2cc1cc01e8058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:12:48 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Creating volume 17b5c542-405c-462d-8bb0-e479d38d536e {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:12:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:48 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:48 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:48 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:12:48 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:12:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-17b5c542-405c-462d-8bb0-e479d38d536e 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:48 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-17b5c542-405c-462d-8bb0-e479d38d536e 1073741824 Sep 06 08:12:48 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3604e8ee-7cb0-45c7-8e2c-cbf556092d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75aa8813-91d5-4730-b2f1-622cc5454f22', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1e61a5-f676-4b83-9f86-e82a6ea84f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:48 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Volume volume-75aa8813-91d5-4730-b2f1-622cc5454f22 (75aa8813-91d5-4730-b2f1-622cc5454f22): created successfully Sep 06 08:12:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1e61a5-f676-4b83-9f86-e82a6ea84f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Flow 'volume_create_manager' (eca6ecf0-10ac-40bc-9fca-6943533d0ffc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:48 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-11e55c83-3ed8-429c-9a43-507c7854ace2 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Created volume successfully. Sep 06 08:12:49 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-17b5c542-405c-462d-8bb0-e479d38d536e 1073741824" returned: 0 in 0.637s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:49 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:UPDATE=140,cinder:SELECT=136,cinder:INSERT=37,cinder:DELETE=14 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:12:49 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=140,cinder:UPDATE=178,cinder:INSERT=40,cinder:DELETE=13 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:12:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-17b5c542-405c-462d-8bb0-e479d38d536e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:49 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-17b5c542-405c-462d-8bb0-e479d38d536e Sep 06 08:12:49 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:50 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-17b5c542-405c-462d-8bb0-e479d38d536e" returned: 0 in 0.520s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:50 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:12:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.225s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:50 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-889079999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286fafe7d88b4f49a79fd5ad0212c119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:47Z,use_quota=True,user_id='13d3dcad2a9f4968afb2cc1cc01e8058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:12:50 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Creating volume fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:12:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:50 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:50 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:50 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:12:50 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:12:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe421b1-b0d8-41ff-95b7-fd6580952830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17b5c542-405c-462d-8bb0-e479d38d536e', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:50 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3 1073741824 Sep 06 08:12:50 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055a8a03-2065-4792-a390-5fa1f8dd6f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:50 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Volume volume-17b5c542-405c-462d-8bb0-e479d38d536e (17b5c542-405c-462d-8bb0-e479d38d536e): created successfully Sep 06 08:12:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055a8a03-2065-4792-a390-5fa1f8dd6f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Flow 'volume_create_manager' (06f249c9-12a4-4fe4-a904-e09ed1e6d4a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:50 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-5ac194b0-6658-48bd-b14e-586d633ddb2e tempest-CreateVolumesFromSnapshotTest-1396099469 None] Created volume successfully. Sep 06 08:12:50 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3 1073741824" returned: 0 in 0.582s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:50 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3 Sep 06 08:12:50 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:51 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3" returned: 0 in 0.323s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.536s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-105798928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c4f937-e5ab-46e9-97c7-1937599853cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286fafe7d88b4f49a79fd5ad0212c119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:47Z,use_quota=True,user_id='13d3dcad2a9f4968afb2cc1cc01e8058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Creating volume 46c4f937-e5ab-46e9-97c7-1937599853cf {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:12:51 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-46c4f937-e5ab-46e9-97c7-1937599853cf 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:51 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-46c4f937-e5ab-46e9-97c7-1937599853cf 1073741824 Sep 06 08:12:51 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9084d03c-31e3-4890-b0e6-cb0c3fa915ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dde2a68-524e-498f-86c9-8faec53ccdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Flow 'volume_create_manager' (826b28b4-3ca7-4e4d-8106-2d8dd0748b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4ff8f9-56b5-4327-b854-bc3bd6b46324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:51 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Volume volume-fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3 (fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3): created successfully Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dde2a68-524e-498f-86c9-8faec53ccdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Flow 'volume_create_manager' (b60b88cb-9a9a-454e-9531-6fa68f119ddd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4ff8f9-56b5-4327-b854-bc3bd6b46324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1564643118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc262a8-3aae-44bb-9b9d-910cd13bebe2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bf474f61838147fea71136db0e67472a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:51Z,use_quota=True,user_id='9cd7cadf460c4ab884609e3ef20811df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc951e1-b0fc-444a-8814-f33314daebf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc951e1-b0fc-444a-8814-f33314daebf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a9dc9f-f82c-4204-85fc-c521fdc217bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a9dc9f-f82c-4204-85fc-c521fdc217bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edc262a8-3aae-44bb-9b9d-910cd13bebe2', 'volume_name': 'volume-edc262a8-3aae-44bb-9b9d-910cd13bebe2', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7569dd-f89b-462b-bca8-00572086e812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7569dd-f89b-462b-bca8-00572086e812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138da43f-789b-4707-a4fc-55ffb13b1642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:51 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Volume edc262a8-3aae-44bb-9b9d-910cd13bebe2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edc262a8-3aae-44bb-9b9d-910cd13bebe2', 'volume_size': 1} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:51 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-056502c8-3c94-40ef-98ea-c3640297af3d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Created volume successfully. Sep 06 08:12:51 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-46c4f937-e5ab-46e9-97c7-1937599853cf 1073741824" returned: 0 in 0.493s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-46c4f937-e5ab-46e9-97c7-1937599853cf {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:51 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-46c4f937-e5ab-46e9-97c7-1937599853cf Sep 06 08:12:51 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:51 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-46c4f937-e5ab-46e9-97c7-1937599853cf" returned: 0 in 0.275s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.890s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1803482866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67b9b9e-4ab1-4519-8080-fdda3ad94bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286fafe7d88b4f49a79fd5ad0212c119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:48Z,use_quota=True,user_id='13d3dcad2a9f4968afb2cc1cc01e8058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Creating volume c67b9b9e-4ab1-4519-8080-fdda3ad94bb9 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:12:51 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c67b9b9e-4ab1-4519-8080-fdda3ad94bb9 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8a155c-401a-4898-b633-f5bdefbec344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46c4f937-e5ab-46e9-97c7-1937599853cf', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:51 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c67b9b9e-4ab1-4519-8080-fdda3ad94bb9 1073741824 Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8f2636-6f7b-417e-91ff-1feb845b111f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:51 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:51 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Volume volume-46c4f937-e5ab-46e9-97c7-1937599853cf (46c4f937-e5ab-46e9-97c7-1937599853cf): created successfully Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8f2636-6f7b-417e-91ff-1feb845b111f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Flow 'volume_create_manager' (5370b48f-a4ab-4616-9d64-2546bbaff8f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:51 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-cd6c8638-0aed-4225-ac2c-70a32073c86b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Created volume successfully. Sep 06 08:12:52 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c67b9b9e-4ab1-4519-8080-fdda3ad94bb9 1073741824" returned: 0 in 0.569s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c67b9b9e-4ab1-4519-8080-fdda3ad94bb9 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:52 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c67b9b9e-4ab1-4519-8080-fdda3ad94bb9 Sep 06 08:12:52 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:52 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c67b9b9e-4ab1-4519-8080-fdda3ad94bb9" returned: 0 in 0.252s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:52 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:12:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0e0da7dd-0dc8-453c-93a7-7ead0c95cfc2 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.175s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:52 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb995fa-0c54-4ca4-be79-6b6b27ab62af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c67b9b9e-4ab1-4519-8080-fdda3ad94bb9', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:52 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (256d7166-6360-4fbf-90e3-b182f222bb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:52 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-0e0da7dd-0dc8-453c-93a7-7ead0c95cfc2 tempest-VolumesSnapshotListTestJSON-1139688237 None] Creating offline snapshot 7f5c2eca-300f-4282-9282-63d7fc3c53c2 of volume 2ce06588-50c0-4e5d-a664-7b15015920c9 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:12:52 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[197017f4-4589-4d1d-bac2-9584a586bb7f]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0e0da7dd-0dc8-453c-93a7-7ead0c95cfc2 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:52 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Volume volume-c67b9b9e-4ab1-4519-8080-fdda3ad94bb9 (c67b9b9e-4ab1-4519-8080-fdda3ad94bb9): created successfully Sep 06 08:12:52 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (256d7166-6360-4fbf-90e3-b182f222bb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:52 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Flow 'volume_create_manager' (b153fb08-4e1d-4ad6-b186-96ce3cf4d115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:52 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-169d5549-6b3c-4434-ba3b-24adb374874a tempest-CreateVolumesFromSnapshotTest-1396099469 None] Created volume successfully. Sep 06 08:12:53 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6 Sep 06 08:12:53 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:53 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0e0da7dd-0dc8-453c-93a7-7ead0c95cfc2 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6" returned: 0 in 0.388s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-0e0da7dd-0dc8-453c-93a7-7ead0c95cfc2 tempest-VolumesSnapshotListTestJSON-1139688237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ce06588-50c0-4e5d-a664-7b15015920c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:12:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0e0da7dd-0dc8-453c-93a7-7ead0c95cfc2 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:53 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2 1G Sep 06 08:12:53 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-33e18cd1-64ae-4215-ae3e-b58664d3d701 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "cinder-c67b9b9e-4ab1-4519-8080-fdda3ad94bb9-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-33e18cd1-64ae-4215-ae3e-b58664d3d701 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-c67b9b9e-4ab1-4519-8080-fdda3ad94bb9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-33e18cd1-64ae-4215-ae3e-b58664d3d701 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "cinder-quobyte-c67b9b9e-4ab1-4519-8080-fdda3ad94bb9" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-33e18cd1-64ae-4215-ae3e-b58664d3d701 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-quobyte-c67b9b9e-4ab1-4519-8080-fdda3ad94bb9" acquired by "delete_volume" :: waited 0.016s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:53 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[029c0fd1-7a16-4fa9-ac07-5c3dc5cc856a]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-33e18cd1-64ae-4215-ae3e-b58664d3d701 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c67b9b9e-4ab1-4519-8080-fdda3ad94bb9 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:53 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c67b9b9e-4ab1-4519-8080-fdda3ad94bb9 Sep 06 08:12:53 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:53 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0e0da7dd-0dc8-453c-93a7-7ead0c95cfc2 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2 1G" returned: 0 in 0.558s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0e0da7dd-0dc8-453c-93a7-7ead0c95cfc2 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:53 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2 Sep 06 08:12:53 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:54 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-33e18cd1-64ae-4215-ae3e-b58664d3d701 tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c67b9b9e-4ab1-4519-8080-fdda3ad94bb9" returned: 0 in 0.415s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-33e18cd1-64ae-4215-ae3e-b58664d3d701 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c67b9b9e-4ab1-4519-8080-fdda3ad94bb9 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:54 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c67b9b9e-4ab1-4519-8080-fdda3ad94bb9 Sep 06 08:12:54 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:54 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0e0da7dd-0dc8-453c-93a7-7ead0c95cfc2 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2" returned: 0 in 0.367s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:54 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-0e0da7dd-0dc8-453c-93a7-7ead0c95cfc2 tempest-VolumesSnapshotListTestJSON-1139688237 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2 is being set with open permissions: ugo+rw Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0e0da7dd-0dc8-453c-93a7-7ead0c95cfc2 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:54 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2 Sep 06 08:12:54 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:54 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-33e18cd1-64ae-4215-ae3e-b58664d3d701 tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c67b9b9e-4ab1-4519-8080-fdda3ad94bb9" returned: 0 in 0.285s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-33e18cd1-64ae-4215-ae3e-b58664d3d701 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-quobyte-c67b9b9e-4ab1-4519-8080-fdda3ad94bb9" released by "delete_volume" :: held 0.748s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-33e18cd1-64ae-4215-ae3e-b58664d3d701 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Created reservations ['6d305150-dc47-40e6-8f7b-f7e09f22552f', 'eba16926-26f4-4810-8bd8-fa380700f5dd', 'dae76298-2afc-426a-8993-73f3d525361f', '2df0884a-8703-469f-a6d2-bed38fe64aef'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-33e18cd1-64ae-4215-ae3e-b58664d3d701 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-33e18cd1-64ae-4215-ae3e-b58664d3d701 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-33e18cd1-64ae-4215-ae3e-b58664d3d701 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-33e18cd1-64ae-4215-ae3e-b58664d3d701 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-33e18cd1-64ae-4215-ae3e-b58664d3d701 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-33e18cd1-64ae-4215-ae3e-b58664d3d701 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:54 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0e0da7dd-0dc8-453c-93a7-7ead0c95cfc2 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2" returned: 0 in 0.289s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:54 devstack sudo[99373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:12:54 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0e0da7dd-0dc8-453c-93a7-7ead0c95cfc2 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.780s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.352s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1564643118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc262a8-3aae-44bb-9b9d-910cd13bebe2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bf474f61838147fea71136db0e67472a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:51Z,use_quota=True,user_id='9cd7cadf460c4ab884609e3ef20811df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Creating volume edc262a8-3aae-44bb-9b9d-910cd13bebe2 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:12:54 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-edc262a8-3aae-44bb-9b9d-910cd13bebe2 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:54 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-edc262a8-3aae-44bb-9b9d-910cd13bebe2 1073741824 Sep 06 08:12:54 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-0e0da7dd-0dc8-453c-93a7-7ead0c95cfc2 tempest-VolumesSnapshotListTestJSON-1139688237 None] Create snapshot completed successfully Sep 06 08:12:54 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e28e2e33-fd52-4e6b-b90d-43983a492c5b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "cinder-46c4f937-e5ab-46e9-97c7-1937599853cf-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e28e2e33-fd52-4e6b-b90d-43983a492c5b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-46c4f937-e5ab-46e9-97c7-1937599853cf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e28e2e33-fd52-4e6b-b90d-43983a492c5b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "cinder-quobyte-46c4f937-e5ab-46e9-97c7-1937599853cf" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e28e2e33-fd52-4e6b-b90d-43983a492c5b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-quobyte-46c4f937-e5ab-46e9-97c7-1937599853cf" acquired by "delete_volume" :: waited 0.024s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:54 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-33e18cd1-64ae-4215-ae3e-b58664d3d701 tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.395s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-33e18cd1-64ae-4215-ae3e-b58664d3d701 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:12:54 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-33e18cd1-64ae-4215-ae3e-b58664d3d701 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Deleted volume successfully. Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3475e72-7544-458f-b8ca-dfd620c51701]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e28e2e33-fd52-4e6b-b90d-43983a492c5b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-46c4f937-e5ab-46e9-97c7-1937599853cf {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-33e18cd1-64ae-4215-ae3e-b58664d3d701 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-c67b9b9e-4ab1-4519-8080-fdda3ad94bb9-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:55 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-46c4f937-e5ab-46e9-97c7-1937599853cf Sep 06 08:12:55 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-673b6cb2-cc8b-4de1-8a0f-b88ac0e2048e tempest-VolumesSnapshotListTestJSON-1139688237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:55 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-edc262a8-3aae-44bb-9b9d-910cd13bebe2 1073741824" returned: 0 in 0.673s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-edc262a8-3aae-44bb-9b9d-910cd13bebe2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:55 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-edc262a8-3aae-44bb-9b9d-910cd13bebe2 Sep 06 08:12:55 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:55 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e28e2e33-fd52-4e6b-b90d-43983a492c5b tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-46c4f937-e5ab-46e9-97c7-1937599853cf" returned: 0 in 0.468s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e28e2e33-fd52-4e6b-b90d-43983a492c5b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-46c4f937-e5ab-46e9-97c7-1937599853cf {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:55 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-46c4f937-e5ab-46e9-97c7-1937599853cf Sep 06 08:12:55 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:55 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-edc262a8-3aae-44bb-9b9d-910cd13bebe2" returned: 0 in 0.266s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-673b6cb2-cc8b-4de1-8a0f-b88ac0e2048e tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.384s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-673b6cb2-cc8b-4de1-8a0f-b88ac0e2048e tempest-VolumesSnapshotListTestJSON-1139688237 None] Creating offline snapshot 1dd75c35-459d-44c1-8b72-1e36430f868a of volume 2ce06588-50c0-4e5d-a664-7b15015920c9 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138da43f-789b-4707-a4fc-55ffb13b1642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edc262a8-3aae-44bb-9b9d-910cd13bebe2', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edcc0ec1-5931-42d1-84f7-140fdf02ba89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed88f19d-35a6-4887-9244-64bdf66fae64]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-673b6cb2-cc8b-4de1-8a0f-b88ac0e2048e tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:55 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e28e2e33-fd52-4e6b-b90d-43983a492c5b tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-46c4f937-e5ab-46e9-97c7-1937599853cf" returned: 0 in 0.286s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e28e2e33-fd52-4e6b-b90d-43983a492c5b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-quobyte-46c4f937-e5ab-46e9-97c7-1937599853cf" released by "delete_volume" :: held 0.845s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:55 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Volume volume-edc262a8-3aae-44bb-9b9d-910cd13bebe2 (edc262a8-3aae-44bb-9b9d-910cd13bebe2): created successfully Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edcc0ec1-5931-42d1-84f7-140fdf02ba89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Flow 'volume_create_manager' (826b28b4-3ca7-4e4d-8106-2d8dd0748b90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:55 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-b1739ed6-63dc-485d-ae82-ea861abe6fe3 tempest-VolumesTestJSON-364947799 None] Created volume successfully. Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-e28e2e33-fd52-4e6b-b90d-43983a492c5b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Created reservations ['a5442fa8-5ffa-4658-bb17-99966a1b4e50', 'b4c05a60-c122-4d48-b3d0-2635c4a61f17', '73d14214-0223-4991-a1e0-04ae9fc6eb16', '4c1f973f-6688-464f-8f94-b67df4176d0b'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:12:55 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2 Sep 06 08:12:55 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e28e2e33-fd52-4e6b-b90d-43983a492c5b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e28e2e33-fd52-4e6b-b90d-43983a492c5b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e28e2e33-fd52-4e6b-b90d-43983a492c5b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e28e2e33-fd52-4e6b-b90d-43983a492c5b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e28e2e33-fd52-4e6b-b90d-43983a492c5b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e28e2e33-fd52-4e6b-b90d-43983a492c5b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:55 devstack sudo[99394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:12:55 devstack sudo[99394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-28abc564-dac5-49cf-a60b-a2eb80782c72 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "cinder-fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-28abc564-dac5-49cf-a60b-a2eb80782c72 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-28abc564-dac5-49cf-a60b-a2eb80782c72 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "cinder-quobyte-fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:56 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-28abc564-dac5-49cf-a60b-a2eb80782c72 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-quobyte-fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3" acquired by "delete_volume" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-673b6cb2-cc8b-4de1-8a0f-b88ac0e2048e tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2" returned: 0 in 0.602s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-673b6cb2-cc8b-4de1-8a0f-b88ac0e2048e tempest-VolumesSnapshotListTestJSON-1139688237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ce06588-50c0-4e5d-a664-7b15015920c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:12:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-673b6cb2-cc8b-4de1-8a0f-b88ac0e2048e tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.1dd75c35-459d-44c1-8b72-1e36430f868a 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:56 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[396926b4-2aba-41b5-ab9b-a062ece9ce3d]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-28abc564-dac5-49cf-a60b-a2eb80782c72 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:56 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.1dd75c35-459d-44c1-8b72-1e36430f868a 1G Sep 06 08:12:56 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:56 devstack sudo[99394]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e28e2e33-fd52-4e6b-b90d-43983a492c5b tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.475s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:56 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-e28e2e33-fd52-4e6b-b90d-43983a492c5b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:12:56 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e28e2e33-fd52-4e6b-b90d-43983a492c5b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Deleted volume successfully. Sep 06 08:12:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e28e2e33-fd52-4e6b-b90d-43983a492c5b tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-46c4f937-e5ab-46e9-97c7-1937599853cf-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:56 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3 Sep 06 08:12:56 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:56 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-28abc564-dac5-49cf-a60b-a2eb80782c72 tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3" returned: 0 in 0.524s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-28abc564-dac5-49cf-a60b-a2eb80782c72 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:56 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3 Sep 06 08:12:56 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:56 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-673b6cb2-cc8b-4de1-8a0f-b88ac0e2048e tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.1dd75c35-459d-44c1-8b72-1e36430f868a 1G" returned: 0 in 0.678s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-673b6cb2-cc8b-4de1-8a0f-b88ac0e2048e tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.1dd75c35-459d-44c1-8b72-1e36430f868a {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:56 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.1dd75c35-459d-44c1-8b72-1e36430f868a Sep 06 08:12:56 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:57 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-28abc564-dac5-49cf-a60b-a2eb80782c72 tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3" returned: 0 in 0.433s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-28abc564-dac5-49cf-a60b-a2eb80782c72 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-quobyte-fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3" released by "delete_volume" :: held 1.022s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-28abc564-dac5-49cf-a60b-a2eb80782c72 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Created reservations ['f3950c34-9cca-4322-ba8b-68fdb8bce698', '15e9b70c-0cc3-48be-8286-da991b044f5e', '7eadff9d-647b-4769-9c85-b9066eb9f7dc', '2b4290d3-ff63-42b7-8143-3fc05b6063af'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:12:57 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-673b6cb2-cc8b-4de1-8a0f-b88ac0e2048e tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.1dd75c35-459d-44c1-8b72-1e36430f868a" returned: 0 in 0.476s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:57 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-673b6cb2-cc8b-4de1-8a0f-b88ac0e2048e tempest-VolumesSnapshotListTestJSON-1139688237 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.1dd75c35-459d-44c1-8b72-1e36430f868a is being set with open permissions: ugo+rw Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-673b6cb2-cc8b-4de1-8a0f-b88ac0e2048e tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.1dd75c35-459d-44c1-8b72-1e36430f868a {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:57 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.1dd75c35-459d-44c1-8b72-1e36430f868a Sep 06 08:12:57 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-28abc564-dac5-49cf-a60b-a2eb80782c72 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-28abc564-dac5-49cf-a60b-a2eb80782c72 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-28abc564-dac5-49cf-a60b-a2eb80782c72 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-28abc564-dac5-49cf-a60b-a2eb80782c72 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-28abc564-dac5-49cf-a60b-a2eb80782c72 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-28abc564-dac5-49cf-a60b-a2eb80782c72 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:57 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:12:57 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Flow 'volume_create_manager' (bce427ba-add4-4bc0-b681-75283f5cb605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5eebcef-2c4b-486c-8986-97f61d7ab8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5eebcef-2c4b-486c-8986-97f61d7ab8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1807997994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea731de-6f02-4cc5-a1b3-0dd76dc72a78,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bf474f61838147fea71136db0e67472a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:58Z,use_quota=True,user_id='9cd7cadf460c4ab884609e3ef20811df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7460ba-d319-44b9-bd71-e6d65a7dcf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7460ba-d319-44b9-bd71-e6d65a7dcf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a029621-5a5c-444d-afcf-ed8b69fffa79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:57 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a029621-5a5c-444d-afcf-ed8b69fffa79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aea731de-6f02-4cc5-a1b3-0dd76dc72a78', 'volume_name': 'volume-aea731de-6f02-4cc5-a1b3-0dd76dc72a78', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1c3a8f-9727-4bfb-bcf6-e46a8a4279c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1c3a8f-9727-4bfb-bcf6-e46a8a4279c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1164f71-39b7-4354-a077-0b5e744f1f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:57 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Volume aea731de-6f02-4cc5-a1b3-0dd76dc72a78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aea731de-6f02-4cc5-a1b3-0dd76dc72a78', 'volume_size': 1} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-673b6cb2-cc8b-4de1-8a0f-b88ac0e2048e tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.1dd75c35-459d-44c1-8b72-1e36430f868a" returned: 0 in 0.352s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-673b6cb2-cc8b-4de1-8a0f-b88ac0e2048e tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.231s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.046s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1807997994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea731de-6f02-4cc5-a1b3-0dd76dc72a78,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bf474f61838147fea71136db0e67472a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:12:58Z,use_quota=True,user_id='9cd7cadf460c4ab884609e3ef20811df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Creating volume aea731de-6f02-4cc5-a1b3-0dd76dc72a78 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:12:57 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aea731de-6f02-4cc5-a1b3-0dd76dc72a78 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:57 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aea731de-6f02-4cc5-a1b3-0dd76dc72a78 1073741824 Sep 06 08:12:57 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:57 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-673b6cb2-cc8b-4de1-8a0f-b88ac0e2048e tempest-VolumesSnapshotListTestJSON-1139688237 None] Create snapshot completed successfully Sep 06 08:12:57 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-28abc564-dac5-49cf-a60b-a2eb80782c72 tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.370s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-28abc564-dac5-49cf-a60b-a2eb80782c72 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:12:57 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-28abc564-dac5-49cf-a60b-a2eb80782c72 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Deleted volume successfully. Sep 06 08:12:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-28abc564-dac5-49cf-a60b-a2eb80782c72 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-fa6c3db6-8ea2-4e75-bc76-a20a7db9c5d3-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-23a73a08-9dea-4ada-945a-a79bcbcafe28 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "cinder-17b5c542-405c-462d-8bb0-e479d38d536e-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:58 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aea731de-6f02-4cc5-a1b3-0dd76dc72a78 1073741824" returned: 0 in 0.604s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-23a73a08-9dea-4ada-945a-a79bcbcafe28 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-17b5c542-405c-462d-8bb0-e479d38d536e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-23a73a08-9dea-4ada-945a-a79bcbcafe28 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "cinder-quobyte-17b5c542-405c-462d-8bb0-e479d38d536e" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aea731de-6f02-4cc5-a1b3-0dd76dc72a78 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:58 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aea731de-6f02-4cc5-a1b3-0dd76dc72a78 Sep 06 08:12:58 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-23a73a08-9dea-4ada-945a-a79bcbcafe28 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-quobyte-17b5c542-405c-462d-8bb0-e479d38d536e" acquired by "delete_volume" :: waited 0.058s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:58 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2ec0be-1a03-4918-bf14-4b4c89c36b2c]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:12:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-23a73a08-9dea-4ada-945a-a79bcbcafe28 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-17b5c542-405c-462d-8bb0-e479d38d536e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:58 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-17b5c542-405c-462d-8bb0-e479d38d536e Sep 06 08:12:58 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:58 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aea731de-6f02-4cc5-a1b3-0dd76dc72a78" returned: 0 in 0.480s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:58 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:12:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1164f71-39b7-4354-a077-0b5e744f1f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aea731de-6f02-4cc5-a1b3-0dd76dc72a78', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e613d6b-779d-44af-a9ce-c0870763f947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:12:59 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Volume volume-aea731de-6f02-4cc5-a1b3-0dd76dc72a78 (aea731de-6f02-4cc5-a1b3-0dd76dc72a78): created successfully Sep 06 08:12:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e613d6b-779d-44af-a9ce-c0870763f947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:12:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Flow 'volume_create_manager' (bce427ba-add4-4bc0-b681-75283f5cb605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:12:59 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-d1ed747d-b40f-4d8e-a6ca-0ccd9ebe0588 tempest-VolumesTestJSON-364947799 None] Created volume successfully. Sep 06 08:12:59 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-23a73a08-9dea-4ada-945a-a79bcbcafe28 tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-17b5c542-405c-462d-8bb0-e479d38d536e" returned: 0 in 0.635s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-23a73a08-9dea-4ada-945a-a79bcbcafe28 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-17b5c542-405c-462d-8bb0-e479d38d536e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:59 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-17b5c542-405c-462d-8bb0-e479d38d536e Sep 06 08:12:59 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:12:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:12:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:12:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:12:59 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Sep 06 08:12:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:12:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:12:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:12:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-23a73a08-9dea-4ada-945a-a79bcbcafe28 tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-17b5c542-405c-462d-8bb0-e479d38d536e" returned: 0 in 0.495s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:12:59 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:12:59 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:12:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-23a73a08-9dea-4ada-945a-a79bcbcafe28 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-quobyte-17b5c542-405c-462d-8bb0-e479d38d536e" released by "delete_volume" :: held 1.221s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:12:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4726acc1-7f61-4632-9fce-b570c1498659 tempest-VolumesSnapshotListTestJSON-1139688237 None] Acquiring lock "cinder-1dd75c35-459d-44c1-8b72-1e36430f868a-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4726acc1-7f61-4632-9fce-b570c1498659 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "cinder-1dd75c35-459d-44c1-8b72-1e36430f868a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:12:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4726acc1-7f61-4632-9fce-b570c1498659 tempest-VolumesSnapshotListTestJSON-1139688237 None] Acquiring lock "cinder-quobyte-2ce06588-50c0-4e5d-a664-7b15015920c9" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:12:59 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-23a73a08-9dea-4ada-945a-a79bcbcafe28 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Created reservations ['a94c1b6e-49f5-4901-9429-383a813cf803', '32bbfdf2-3cd3-42e8-8da4-594da4217cc6', '4a3421b5-3fbf-4017-b956-014d7eb214be', '7842e014-e87a-44ac-b613-faf4590bb1b6'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4726acc1-7f61-4632-9fce-b570c1498659 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "cinder-quobyte-2ce06588-50c0-4e5d-a664-7b15015920c9" acquired by "delete_snapshot" :: waited 0.083s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4726acc1-7f61-4632-9fce-b570c1498659 tempest-VolumesSnapshotListTestJSON-1139688237 None] Acquiring lock "cinder-quobyte-1dd75c35-459d-44c1-8b72-1e36430f868a" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4726acc1-7f61-4632-9fce-b570c1498659 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "cinder-quobyte-1dd75c35-459d-44c1-8b72-1e36430f868a" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-4726acc1-7f61-4632-9fce-b570c1498659 tempest-VolumesSnapshotListTestJSON-1139688237 None] Deleting offline snapshot 1dd75c35-459d-44c1-8b72-1e36430f868a of volume 2ce06588-50c0-4e5d-a664-7b15015920c9 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-4726acc1-7f61-4632-9fce-b570c1498659 tempest-VolumesSnapshotListTestJSON-1139688237 None] snapshot_file for this snap is: volume-2ce06588-50c0-4e5d-a664-7b15015920c9.1dd75c35-459d-44c1-8b72-1e36430f868a {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c3fe0c-6391-41dd-86a3-552c019b8d43]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:13:00 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4726acc1-7f61-4632-9fce-b570c1498659 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.1dd75c35-459d-44c1-8b72-1e36430f868a {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.507s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager._thread_info {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread count: 28 {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread info: [<_MainThread(MainThread, started 139985167040640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-23a73a08-9dea-4ada-945a-a79bcbcafe28 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-23a73a08-9dea-4ada-945a-a79bcbcafe28 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-23a73a08-9dea-4ada-945a-a79bcbcafe28 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-23a73a08-9dea-4ada-945a-a79bcbcafe28 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-23a73a08-9dea-4ada-945a-a79bcbcafe28 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-23a73a08-9dea-4ada-945a-a79bcbcafe28 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:00 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:13:00 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:00 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.1dd75c35-459d-44c1-8b72-1e36430f868a Sep 06 08:13:00 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:00 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Flow 'volume_create_manager' (c58ccf8e-d4c7-4369-b351-caedf4b09a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb046e0-6015-44ce-995f-69e4cb1fa16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-23a73a08-9dea-4ada-945a-a79bcbcafe28 tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.391s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-23a73a08-9dea-4ada-945a-a79bcbcafe28 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:13:00 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-23a73a08-9dea-4ada-945a-a79bcbcafe28 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Deleted volume successfully. Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb046e0-6015-44ce-995f-69e4cb1fa16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1721394994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f18d83-4d6e-4424-b9e6-10ef42c30351,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bf474f61838147fea71136db0e67472a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:13:01Z,use_quota=True,user_id='9cd7cadf460c4ab884609e3ef20811df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a099efc-e289-4c10-ae9d-53afeaf472c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a099efc-e289-4c10-ae9d-53afeaf472c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a544ea-5ddb-4024-a1ab-c198527c8420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:00 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a544ea-5ddb-4024-a1ab-c198527c8420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6f18d83-4d6e-4424-b9e6-10ef42c30351', 'volume_name': 'volume-b6f18d83-4d6e-4424-b9e6-10ef42c30351', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a0e85cd-07b8-4484-9ffc-86b576d15398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a0e85cd-07b8-4484-9ffc-86b576d15398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (713a82cd-b934-4e54-a510-834696877575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:00 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Volume b6f18d83-4d6e-4424-b9e6-10ef42c30351: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6f18d83-4d6e-4424-b9e6-10ef42c30351', 'volume_size': 1} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1721394994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f18d83-4d6e-4424-b9e6-10ef42c30351,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bf474f61838147fea71136db0e67472a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:13:01Z,use_quota=True,user_id='9cd7cadf460c4ab884609e3ef20811df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Creating volume b6f18d83-4d6e-4424-b9e6-10ef42c30351 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:13:00 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b6f18d83-4d6e-4424-b9e6-10ef42c30351 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4726acc1-7f61-4632-9fce-b570c1498659 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.1dd75c35-459d-44c1-8b72-1e36430f868a" returned: 0 in 0.597s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-4726acc1-7f61-4632-9fce-b570c1498659 tempest-VolumesSnapshotListTestJSON-1139688237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ce06588-50c0-4e5d-a664-7b15015920c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:13:00 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b6f18d83-4d6e-4424-b9e6-10ef42c30351 1073741824 Sep 06 08:13:00 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-23a73a08-9dea-4ada-945a-a79bcbcafe28 tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-17b5c542-405c-462d-8bb0-e479d38d536e-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8be53ba-89c0-4847-8e7c-7fd378d2e99d]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4726acc1-7f61-4632-9fce-b570c1498659 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-8f10f617-cb66-4a55-9ddf-f9ebf5ce60dd tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "cinder-75aa8813-91d5-4730-b2f1-622cc5454f22-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-8f10f617-cb66-4a55-9ddf-f9ebf5ce60dd tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-75aa8813-91d5-4730-b2f1-622cc5454f22-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-8f10f617-cb66-4a55-9ddf-f9ebf5ce60dd tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "cinder-quobyte-75aa8813-91d5-4730-b2f1-622cc5454f22" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:13:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-8f10f617-cb66-4a55-9ddf-f9ebf5ce60dd tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-quobyte-75aa8813-91d5-4730-b2f1-622cc5454f22" acquired by "delete_volume" :: waited 0.029s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:01 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a1c327-6ccb-4b11-95c0-220c578baf89]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:13:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8f10f617-cb66-4a55-9ddf-f9ebf5ce60dd tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-75aa8813-91d5-4730-b2f1-622cc5454f22 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:01 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2 Sep 06 08:13:01 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:01 devstack sudo[99460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-75aa8813-91d5-4730-b2f1-622cc5454f22 Sep 06 08:13:01 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:01 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4726acc1-7f61-4632-9fce-b570c1498659 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2" returned: 0 in 0.564s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:01 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-4726acc1-7f61-4632-9fce-b570c1498659 tempest-VolumesSnapshotListTestJSON-1139688237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ce06588-50c0-4e5d-a664-7b15015920c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:13:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4726acc1-7f61-4632-9fce-b570c1498659 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.1dd75c35-459d-44c1-8b72-1e36430f868a {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:01 devstack sudo[99469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.1dd75c35-459d-44c1-8b72-1e36430f868a Sep 06 08:13:01 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:01 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b6f18d83-4d6e-4424-b9e6-10ef42c30351 1073741824" returned: 0 in 0.730s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b6f18d83-4d6e-4424-b9e6-10ef42c30351 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:01 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8f10f617-cb66-4a55-9ddf-f9ebf5ce60dd tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-75aa8813-91d5-4730-b2f1-622cc5454f22" returned: 0 in 0.529s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8f10f617-cb66-4a55-9ddf-f9ebf5ce60dd tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-75aa8813-91d5-4730-b2f1-622cc5454f22 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:01 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b6f18d83-4d6e-4424-b9e6-10ef42c30351 Sep 06 08:13:01 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:01 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-75aa8813-91d5-4730-b2f1-622cc5454f22 Sep 06 08:13:01 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:01 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b6f18d83-4d6e-4424-b9e6-10ef42c30351" returned: 0 in 0.368s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:01 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:13:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:13:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (713a82cd-b934-4e54-a510-834696877575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6f18d83-4d6e-4424-b9e6-10ef42c30351', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f83a054-19ef-49eb-aad4-d007fd55d563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:01 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Volume volume-b6f18d83-4d6e-4424-b9e6-10ef42c30351 (b6f18d83-4d6e-4424-b9e6-10ef42c30351): created successfully Sep 06 08:13:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f83a054-19ef-49eb-aad4-d007fd55d563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:01 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Flow 'volume_create_manager' (c58ccf8e-d4c7-4369-b351-caedf4b09a5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:13:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8f10f617-cb66-4a55-9ddf-f9ebf5ce60dd tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-75aa8813-91d5-4730-b2f1-622cc5454f22" returned: 0 in 0.422s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-8f10f617-cb66-4a55-9ddf-f9ebf5ce60dd tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-quobyte-75aa8813-91d5-4730-b2f1-622cc5454f22" released by "delete_volume" :: held 1.018s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:02 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-2955039d-2bfd-40c7-84fd-f6627365e500 tempest-VolumesTestJSON-364947799 None] Created volume successfully. Sep 06 08:13:02 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-8f10f617-cb66-4a55-9ddf-f9ebf5ce60dd tempest-CreateVolumesFromSnapshotTest-1396099469 None] Created reservations ['d9ae3121-94ef-4282-9cce-66cb23e1894f', '744ef289-6b41-40bd-96b5-3cb3719eb505', '770d7f65-b6b5-4d5d-9369-db3315a39968', '46015fed-457e-4e0b-8cb9-264af53885c4'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:13:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8f10f617-cb66-4a55-9ddf-f9ebf5ce60dd tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:13:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8f10f617-cb66-4a55-9ddf-f9ebf5ce60dd tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:13:02 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:02 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8f10f617-cb66-4a55-9ddf-f9ebf5ce60dd tempest-CreateVolumesFromSnapshotTest-1396099469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:13:02 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8f10f617-cb66-4a55-9ddf-f9ebf5ce60dd tempest-CreateVolumesFromSnapshotTest-1396099469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:13:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8f10f617-cb66-4a55-9ddf-f9ebf5ce60dd tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:13:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8f10f617-cb66-4a55-9ddf-f9ebf5ce60dd tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4726acc1-7f61-4632-9fce-b570c1498659 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.1dd75c35-459d-44c1-8b72-1e36430f868a" returned: 0 in 0.843s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4726acc1-7f61-4632-9fce-b570c1498659 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.1dd75c35-459d-44c1-8b72-1e36430f868a {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:02 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:13:02 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:02 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.1dd75c35-459d-44c1-8b72-1e36430f868a Sep 06 08:13:02 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:02 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8f10f617-cb66-4a55-9ddf-f9ebf5ce60dd tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.248s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:02 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-8f10f617-cb66-4a55-9ddf-f9ebf5ce60dd tempest-CreateVolumesFromSnapshotTest-1396099469 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:13:02 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-8f10f617-cb66-4a55-9ddf-f9ebf5ce60dd tempest-CreateVolumesFromSnapshotTest-1396099469 None] Deleted volume successfully. Sep 06 08:13:02 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4726acc1-7f61-4632-9fce-b570c1498659 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.1dd75c35-459d-44c1-8b72-1e36430f868a" returned: 0 in 0.270s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-8f10f617-cb66-4a55-9ddf-f9ebf5ce60dd tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-75aa8813-91d5-4730-b2f1-622cc5454f22-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4726acc1-7f61-4632-9fce-b570c1498659 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "cinder-quobyte-1dd75c35-459d-44c1-8b72-1e36430f868a" released by "_delete_snapshot" :: held 2.451s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4726acc1-7f61-4632-9fce-b570c1498659 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "cinder-quobyte-2ce06588-50c0-4e5d-a664-7b15015920c9" released by "delete_snapshot" :: held 2.519s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:02 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-4726acc1-7f61-4632-9fce-b570c1498659 tempest-VolumesSnapshotListTestJSON-1139688237 None] Created reservations ['c82768e1-325e-48bf-9ea8-0c4c033fbf8e', 'aa2103d7-4c0b-462d-9c09-8843d09191fc', '0eb85456-96a1-45bf-9dde-48982fed203b', 'ec925a79-9d7e-4698-8315-6ceb7e04180f'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:13:02 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-4726acc1-7f61-4632-9fce-b570c1498659 tempest-VolumesSnapshotListTestJSON-1139688237 None] Delete snapshot completed successfully. Sep 06 08:13:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4726acc1-7f61-4632-9fce-b570c1498659 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "cinder-1dd75c35-459d-44c1-8b72-1e36430f868a-delete_snapshot" released by "delete_snapshot" :: held 2.745s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1fe9b79f-1f91-4798-a48e-6f32e979c6a7 tempest-VolumesSnapshotListTestJSON-1139688237 None] Acquiring lock "cinder-7f5c2eca-300f-4282-9282-63d7fc3c53c2-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4408aeac-78d3-4ba8-9bfd-4618210d198d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "cinder-5d12d15f-db1d-4504-adb7-ae6d580c4bf4-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1fe9b79f-1f91-4798-a48e-6f32e979c6a7 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "cinder-7f5c2eca-300f-4282-9282-63d7fc3c53c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1fe9b79f-1f91-4798-a48e-6f32e979c6a7 tempest-VolumesSnapshotListTestJSON-1139688237 None] Acquiring lock "cinder-quobyte-2ce06588-50c0-4e5d-a664-7b15015920c9" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4408aeac-78d3-4ba8-9bfd-4618210d198d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-5d12d15f-db1d-4504-adb7-ae6d580c4bf4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4408aeac-78d3-4ba8-9bfd-4618210d198d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "cinder-quobyte-ffd571e8-e95c-4008-a70c-c0d2bfa9f475" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1fe9b79f-1f91-4798-a48e-6f32e979c6a7 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "cinder-quobyte-2ce06588-50c0-4e5d-a664-7b15015920c9" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1fe9b79f-1f91-4798-a48e-6f32e979c6a7 tempest-VolumesSnapshotListTestJSON-1139688237 None] Acquiring lock "cinder-quobyte-7f5c2eca-300f-4282-9282-63d7fc3c53c2" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4408aeac-78d3-4ba8-9bfd-4618210d198d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-quobyte-ffd571e8-e95c-4008-a70c-c0d2bfa9f475" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4408aeac-78d3-4ba8-9bfd-4618210d198d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "cinder-quobyte-5d12d15f-db1d-4504-adb7-ae6d580c4bf4" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1fe9b79f-1f91-4798-a48e-6f32e979c6a7 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "cinder-quobyte-7f5c2eca-300f-4282-9282-63d7fc3c53c2" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-1fe9b79f-1f91-4798-a48e-6f32e979c6a7 tempest-VolumesSnapshotListTestJSON-1139688237 None] Deleting offline snapshot 7f5c2eca-300f-4282-9282-63d7fc3c53c2 of volume 2ce06588-50c0-4e5d-a664-7b15015920c9 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-1fe9b79f-1f91-4798-a48e-6f32e979c6a7 tempest-VolumesSnapshotListTestJSON-1139688237 None] snapshot_file for this snap is: volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4408aeac-78d3-4ba8-9bfd-4618210d198d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-quobyte-5d12d15f-db1d-4504-adb7-ae6d580c4bf4" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-4408aeac-78d3-4ba8-9bfd-4618210d198d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Deleting offline snapshot 5d12d15f-db1d-4504-adb7-ae6d580c4bf4 of volume ffd571e8-e95c-4008-a70c-c0d2bfa9f475 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-4408aeac-78d3-4ba8-9bfd-4618210d198d tempest-CreateVolumesFromSnapshotTest-1396099469 None] snapshot_file for this snap is: volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.5d12d15f-db1d-4504-adb7-ae6d580c4bf4 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[211c0b20-d086-4ddb-9c0d-544860e2e483]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1fe9b79f-1f91-4798-a48e-6f32e979c6a7 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ba4265-8394-4be8-b80f-9f7e79fd18c9]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4408aeac-78d3-4ba8-9bfd-4618210d198d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.5d12d15f-db1d-4504-adb7-ae6d580c4bf4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:03 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2 Sep 06 08:13:03 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:03 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.5d12d15f-db1d-4504-adb7-ae6d580c4bf4 Sep 06 08:13:03 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-31ae1157-95f3-4433-9600-94304118afda tempest-VolumesTestJSON-364947799 None] Acquiring lock "cinder-b6f18d83-4d6e-4424-b9e6-10ef42c30351-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-31ae1157-95f3-4433-9600-94304118afda tempest-VolumesTestJSON-364947799 None] Lock "cinder-b6f18d83-4d6e-4424-b9e6-10ef42c30351-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-31ae1157-95f3-4433-9600-94304118afda tempest-VolumesTestJSON-364947799 None] Acquiring lock "cinder-quobyte-b6f18d83-4d6e-4424-b9e6-10ef42c30351" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-31ae1157-95f3-4433-9600-94304118afda tempest-VolumesTestJSON-364947799 None] Lock "cinder-quobyte-b6f18d83-4d6e-4424-b9e6-10ef42c30351" acquired by "delete_volume" :: waited 0.026s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[be36ab0f-e66f-479c-8d51-f37aace56f03]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-31ae1157-95f3-4433-9600-94304118afda tempest-VolumesTestJSON-364947799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b6f18d83-4d6e-4424-b9e6-10ef42c30351 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:03 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1fe9b79f-1f91-4798-a48e-6f32e979c6a7 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2" returned: 0 in 0.471s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-1fe9b79f-1f91-4798-a48e-6f32e979c6a7 tempest-VolumesSnapshotListTestJSON-1139688237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ce06588-50c0-4e5d-a664-7b15015920c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be7efb7-4b18-4f2b-b248-2fdac0a628f3]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1fe9b79f-1f91-4798-a48e-6f32e979c6a7 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:03 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4408aeac-78d3-4ba8-9bfd-4618210d198d tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.5d12d15f-db1d-4504-adb7-ae6d580c4bf4" returned: 0 in 0.541s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:03 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-4408aeac-78d3-4ba8-9bfd-4618210d198d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:13:04 devstack sudo[99502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b6f18d83-4d6e-4424-b9e6-10ef42c30351 Sep 06 08:13:04 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:04 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd59acc-138a-4fee-a365-18e9d7f8f520]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:13:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4408aeac-78d3-4ba8-9bfd-4618210d198d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:04 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6 Sep 06 08:13:04 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:04 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475 Sep 06 08:13:04 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:04 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-31ae1157-95f3-4433-9600-94304118afda tempest-VolumesTestJSON-364947799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b6f18d83-4d6e-4424-b9e6-10ef42c30351" returned: 0 in 0.459s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-31ae1157-95f3-4433-9600-94304118afda tempest-VolumesTestJSON-364947799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b6f18d83-4d6e-4424-b9e6-10ef42c30351 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:04 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1fe9b79f-1f91-4798-a48e-6f32e979c6a7 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6" returned: 0 in 0.414s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:04 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-1fe9b79f-1f91-4798-a48e-6f32e979c6a7 tempest-VolumesSnapshotListTestJSON-1139688237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ce06588-50c0-4e5d-a664-7b15015920c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:13:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1fe9b79f-1f91-4798-a48e-6f32e979c6a7 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:04 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b6f18d83-4d6e-4424-b9e6-10ef42c30351 Sep 06 08:13:04 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:04 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2 Sep 06 08:13:04 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:04 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4408aeac-78d3-4ba8-9bfd-4618210d198d tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475" returned: 0 in 0.435s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4408aeac-78d3-4ba8-9bfd-4618210d198d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.5d12d15f-db1d-4504-adb7-ae6d580c4bf4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:04 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.5d12d15f-db1d-4504-adb7-ae6d580c4bf4 Sep 06 08:13:04 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:04 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-31ae1157-95f3-4433-9600-94304118afda tempest-VolumesTestJSON-364947799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b6f18d83-4d6e-4424-b9e6-10ef42c30351" returned: 0 in 0.322s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:04 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-31ae1157-95f3-4433-9600-94304118afda tempest-VolumesTestJSON-364947799 None] Lock "cinder-quobyte-b6f18d83-4d6e-4424-b9e6-10ef42c30351" released by "delete_volume" :: held 0.834s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:04 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-31ae1157-95f3-4433-9600-94304118afda tempest-VolumesTestJSON-364947799 None] Created reservations ['b995cc85-889c-48f3-8a88-90a112fccdb5', '520dd479-ce28-42ab-9e29-d1874015350d', '421b4ff1-31dd-404d-9f3b-c884242ed196', '3e9ea3f9-aea6-4579-8527-6c14a53e0a59'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:13:04 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1fe9b79f-1f91-4798-a48e-6f32e979c6a7 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2" returned: 0 in 0.458s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1fe9b79f-1f91-4798-a48e-6f32e979c6a7 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-31ae1157-95f3-4433-9600-94304118afda tempest-VolumesTestJSON-364947799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:13:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-31ae1157-95f3-4433-9600-94304118afda tempest-VolumesTestJSON-364947799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:13:04 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-31ae1157-95f3-4433-9600-94304118afda tempest-VolumesTestJSON-364947799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:13:04 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-31ae1157-95f3-4433-9600-94304118afda tempest-VolumesTestJSON-364947799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:13:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-31ae1157-95f3-4433-9600-94304118afda tempest-VolumesTestJSON-364947799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:13:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-31ae1157-95f3-4433-9600-94304118afda tempest-VolumesTestJSON-364947799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:04 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2 Sep 06 08:13:04 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:04 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:13:04 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:04 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4408aeac-78d3-4ba8-9bfd-4618210d198d tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.5d12d15f-db1d-4504-adb7-ae6d580c4bf4" returned: 0 in 0.495s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4408aeac-78d3-4ba8-9bfd-4618210d198d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.5d12d15f-db1d-4504-adb7-ae6d580c4bf4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4e719e52-e38c-41af-a6c9-31a7fdfd557c tempest-VolumesTestJSON-364947799 None] Acquiring lock "cinder-aea731de-6f02-4cc5-a1b3-0dd76dc72a78-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:13:05 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.5d12d15f-db1d-4504-adb7-ae6d580c4bf4 Sep 06 08:13:05 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4e719e52-e38c-41af-a6c9-31a7fdfd557c tempest-VolumesTestJSON-364947799 None] Lock "cinder-aea731de-6f02-4cc5-a1b3-0dd76dc72a78-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4e719e52-e38c-41af-a6c9-31a7fdfd557c tempest-VolumesTestJSON-364947799 None] Acquiring lock "cinder-quobyte-aea731de-6f02-4cc5-a1b3-0dd76dc72a78" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:13:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4e719e52-e38c-41af-a6c9-31a7fdfd557c tempest-VolumesTestJSON-364947799 None] Lock "cinder-quobyte-aea731de-6f02-4cc5-a1b3-0dd76dc72a78" acquired by "delete_volume" :: waited 0.024s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:05 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[363d9e3b-4628-426a-b6aa-4b6b57c13b83]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:13:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4e719e52-e38c-41af-a6c9-31a7fdfd557c tempest-VolumesTestJSON-364947799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aea731de-6f02-4cc5-a1b3-0dd76dc72a78 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:05 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1fe9b79f-1f91-4798-a48e-6f32e979c6a7 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f5c2eca-300f-4282-9282-63d7fc3c53c2" returned: 0 in 0.388s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1fe9b79f-1f91-4798-a48e-6f32e979c6a7 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "cinder-quobyte-7f5c2eca-300f-4282-9282-63d7fc3c53c2" released by "_delete_snapshot" :: held 1.887s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:05 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1fe9b79f-1f91-4798-a48e-6f32e979c6a7 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "cinder-quobyte-2ce06588-50c0-4e5d-a664-7b15015920c9" released by "delete_snapshot" :: held 1.925s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-31ae1157-95f3-4433-9600-94304118afda tempest-VolumesTestJSON-364947799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.431s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:05 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-31ae1157-95f3-4433-9600-94304118afda tempest-VolumesTestJSON-364947799 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:13:05 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-31ae1157-95f3-4433-9600-94304118afda tempest-VolumesTestJSON-364947799 None] Deleted volume successfully. Sep 06 08:13:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-31ae1157-95f3-4433-9600-94304118afda tempest-VolumesTestJSON-364947799 None] Lock "cinder-b6f18d83-4d6e-4424-b9e6-10ef42c30351-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:05 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4408aeac-78d3-4ba8-9bfd-4618210d198d tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475.5d12d15f-db1d-4504-adb7-ae6d580c4bf4" returned: 0 in 0.378s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:05 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aea731de-6f02-4cc5-a1b3-0dd76dc72a78 Sep 06 08:13:05 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:05 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-1fe9b79f-1f91-4798-a48e-6f32e979c6a7 tempest-VolumesSnapshotListTestJSON-1139688237 None] Created reservations ['6f2df2d0-2536-48b8-abb7-4e84ebbb8f53', 'aed4d02c-3a4d-4551-be5b-d6603ee5f17e', '4c40dffe-7ee3-46d6-8807-2ddf0aec9295', '4ba5a7f9-2f89-469f-8236-45f46f67c7b7'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:13:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4408aeac-78d3-4ba8-9bfd-4618210d198d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-quobyte-5d12d15f-db1d-4504-adb7-ae6d580c4bf4" released by "_delete_snapshot" :: held 2.005s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4408aeac-78d3-4ba8-9bfd-4618210d198d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-quobyte-ffd571e8-e95c-4008-a70c-c0d2bfa9f475" released by "delete_snapshot" :: held 2.063s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:05 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-1fe9b79f-1f91-4798-a48e-6f32e979c6a7 tempest-VolumesSnapshotListTestJSON-1139688237 None] Delete snapshot completed successfully. Sep 06 08:13:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1fe9b79f-1f91-4798-a48e-6f32e979c6a7 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "cinder-7f5c2eca-300f-4282-9282-63d7fc3c53c2-delete_snapshot" released by "delete_snapshot" :: held 2.242s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:05 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-4408aeac-78d3-4ba8-9bfd-4618210d198d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Created reservations ['ac969fef-ef52-4174-b59c-b1c1c2a30864', 'e74f66af-d9ea-410d-aba4-d5b198a4f222', 'b68baac3-ae4b-41b5-986c-bcdac57c49cf', '43e2d00a-bdc2-4134-9a08-8f0ecac8a809'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:13:05 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-4408aeac-78d3-4ba8-9bfd-4618210d198d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Delete snapshot completed successfully. Sep 06 08:13:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4408aeac-78d3-4ba8-9bfd-4618210d198d tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-5d12d15f-db1d-4504-adb7-ae6d580c4bf4-delete_snapshot" released by "delete_snapshot" :: held 2.265s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:05 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4e719e52-e38c-41af-a6c9-31a7fdfd557c tempest-VolumesTestJSON-364947799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aea731de-6f02-4cc5-a1b3-0dd76dc72a78" returned: 0 in 0.509s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4e719e52-e38c-41af-a6c9-31a7fdfd557c tempest-VolumesTestJSON-364947799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aea731de-6f02-4cc5-a1b3-0dd76dc72a78 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:05 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aea731de-6f02-4cc5-a1b3-0dd76dc72a78 Sep 06 08:13:05 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:05 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4e719e52-e38c-41af-a6c9-31a7fdfd557c tempest-VolumesTestJSON-364947799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aea731de-6f02-4cc5-a1b3-0dd76dc72a78" returned: 0 in 0.274s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4e719e52-e38c-41af-a6c9-31a7fdfd557c tempest-VolumesTestJSON-364947799 None] Lock "cinder-quobyte-aea731de-6f02-4cc5-a1b3-0dd76dc72a78" released by "delete_volume" :: held 0.845s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-4e719e52-e38c-41af-a6c9-31a7fdfd557c tempest-VolumesTestJSON-364947799 None] Created reservations ['00fde2ee-b0bc-44ee-bb7d-7ebfeda855d7', '407e0568-e669-4039-b757-1896d69026e6', 'c2f5fa6e-c4be-4f65-953c-130fdb5e2047', '351ba617-0b8e-430c-9d40-d94c500f6690'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-4e719e52-e38c-41af-a6c9-31a7fdfd557c tempest-VolumesTestJSON-364947799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-4e719e52-e38c-41af-a6c9-31a7fdfd557c tempest-VolumesTestJSON-364947799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-4e719e52-e38c-41af-a6c9-31a7fdfd557c tempest-VolumesTestJSON-364947799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-4e719e52-e38c-41af-a6c9-31a7fdfd557c tempest-VolumesTestJSON-364947799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-4e719e52-e38c-41af-a6c9-31a7fdfd557c tempest-VolumesTestJSON-364947799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4e719e52-e38c-41af-a6c9-31a7fdfd557c tempest-VolumesTestJSON-364947799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:06 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:13:06 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0db5a91a-0923-4329-b645-859ecad37b5b tempest-VolumesTestJSON-364947799 None] Acquiring lock "cinder-edc262a8-3aae-44bb-9b9d-910cd13bebe2-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0db5a91a-0923-4329-b645-859ecad37b5b tempest-VolumesTestJSON-364947799 None] Lock "cinder-edc262a8-3aae-44bb-9b9d-910cd13bebe2-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0db5a91a-0923-4329-b645-859ecad37b5b tempest-VolumesTestJSON-364947799 None] Acquiring lock "cinder-quobyte-edc262a8-3aae-44bb-9b9d-910cd13bebe2" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0db5a91a-0923-4329-b645-859ecad37b5b tempest-VolumesTestJSON-364947799 None] Lock "cinder-quobyte-edc262a8-3aae-44bb-9b9d-910cd13bebe2" acquired by "delete_volume" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0cb1fd-fb87-4400-a0c9-6e269e30e1a3]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0db5a91a-0923-4329-b645-859ecad37b5b tempest-VolumesTestJSON-364947799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-edc262a8-3aae-44bb-9b9d-910cd13bebe2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:06 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4e719e52-e38c-41af-a6c9-31a7fdfd557c tempest-VolumesTestJSON-364947799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.279s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-4e719e52-e38c-41af-a6c9-31a7fdfd557c tempest-VolumesTestJSON-364947799 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:13:06 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-4e719e52-e38c-41af-a6c9-31a7fdfd557c tempest-VolumesTestJSON-364947799 None] Deleted volume successfully. Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4e719e52-e38c-41af-a6c9-31a7fdfd557c tempest-VolumesTestJSON-364947799 None] Lock "cinder-aea731de-6f02-4cc5-a1b3-0dd76dc72a78-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:06 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-edc262a8-3aae-44bb-9b9d-910cd13bebe2 Sep 06 08:13:06 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ac7c33a-3325-48ae-bc35-bc5000c811f5 tempest-VolumesSnapshotListTestJSON-1139688237 None] Acquiring lock "cinder-7f69537c-5a23-455b-9df4-ea9402187bb6-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ac7c33a-3325-48ae-bc35-bc5000c811f5 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "cinder-7f69537c-5a23-455b-9df4-ea9402187bb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ac7c33a-3325-48ae-bc35-bc5000c811f5 tempest-VolumesSnapshotListTestJSON-1139688237 None] Acquiring lock "cinder-quobyte-2ce06588-50c0-4e5d-a664-7b15015920c9" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e6b9230a-5a67-43fc-9d82-9122a6d47daf tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "cinder-ffd571e8-e95c-4008-a70c-c0d2bfa9f475-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ac7c33a-3325-48ae-bc35-bc5000c811f5 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "cinder-quobyte-2ce06588-50c0-4e5d-a664-7b15015920c9" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ac7c33a-3325-48ae-bc35-bc5000c811f5 tempest-VolumesSnapshotListTestJSON-1139688237 None] Acquiring lock "cinder-quobyte-7f69537c-5a23-455b-9df4-ea9402187bb6" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e6b9230a-5a67-43fc-9d82-9122a6d47daf tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-ffd571e8-e95c-4008-a70c-c0d2bfa9f475-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ac7c33a-3325-48ae-bc35-bc5000c811f5 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "cinder-quobyte-7f69537c-5a23-455b-9df4-ea9402187bb6" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-0ac7c33a-3325-48ae-bc35-bc5000c811f5 tempest-VolumesSnapshotListTestJSON-1139688237 None] Deleting offline snapshot 7f69537c-5a23-455b-9df4-ea9402187bb6 of volume 2ce06588-50c0-4e5d-a664-7b15015920c9 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-0ac7c33a-3325-48ae-bc35-bc5000c811f5 tempest-VolumesSnapshotListTestJSON-1139688237 None] snapshot_file for this snap is: volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be62d46-c9d6-4a36-9294-1ebc7170b5d6]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ac7c33a-3325-48ae-bc35-bc5000c811f5 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e6b9230a-5a67-43fc-9d82-9122a6d47daf tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "cinder-quobyte-ffd571e8-e95c-4008-a70c-c0d2bfa9f475" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e6b9230a-5a67-43fc-9d82-9122a6d47daf tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-quobyte-ffd571e8-e95c-4008-a70c-c0d2bfa9f475" acquired by "delete_volume" :: waited 0.023s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca892be-53fd-47dd-a765-ab73b98d7bbe]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e6b9230a-5a67-43fc-9d82-9122a6d47daf tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:06 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0db5a91a-0923-4329-b645-859ecad37b5b tempest-VolumesTestJSON-364947799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-edc262a8-3aae-44bb-9b9d-910cd13bebe2" returned: 0 in 0.483s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0db5a91a-0923-4329-b645-859ecad37b5b tempest-VolumesTestJSON-364947799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-edc262a8-3aae-44bb-9b9d-910cd13bebe2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:06 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6 Sep 06 08:13:06 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:06 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-edc262a8-3aae-44bb-9b9d-910cd13bebe2 Sep 06 08:13:06 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:07 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475 Sep 06 08:13:07 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:07 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0db5a91a-0923-4329-b645-859ecad37b5b tempest-VolumesTestJSON-364947799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-edc262a8-3aae-44bb-9b9d-910cd13bebe2" returned: 0 in 0.296s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:07 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0db5a91a-0923-4329-b645-859ecad37b5b tempest-VolumesTestJSON-364947799 None] Lock "cinder-quobyte-edc262a8-3aae-44bb-9b9d-910cd13bebe2" released by "delete_volume" :: held 0.837s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:07 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-0db5a91a-0923-4329-b645-859ecad37b5b tempest-VolumesTestJSON-364947799 None] Created reservations ['f889bade-4e2a-46af-8890-b53f21485cab', '6700d04d-c280-4ee6-9504-422b1234040c', '6a73739c-5a9a-446c-9444-c2b9e467f110', '69035b0d-b834-4464-8981-be5e13f11ce1'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:13:07 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ac7c33a-3325-48ae-bc35-bc5000c811f5 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6" returned: 0 in 0.528s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-0ac7c33a-3325-48ae-bc35-bc5000c811f5 tempest-VolumesSnapshotListTestJSON-1139688237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ce06588-50c0-4e5d-a664-7b15015920c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:13:07 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdd13d2-6d01-47e0-9643-6195ac73c137]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:13:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ac7c33a-3325-48ae-bc35-bc5000c811f5 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:07 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e6b9230a-5a67-43fc-9d82-9122a6d47daf tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475" returned: 0 in 0.508s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e6b9230a-5a67-43fc-9d82-9122a6d47daf tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:07 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475 Sep 06 08:13:07 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0db5a91a-0923-4329-b645-859ecad37b5b tempest-VolumesTestJSON-364947799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:13:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0db5a91a-0923-4329-b645-859ecad37b5b tempest-VolumesTestJSON-364947799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:13:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0db5a91a-0923-4329-b645-859ecad37b5b tempest-VolumesTestJSON-364947799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:13:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0db5a91a-0923-4329-b645-859ecad37b5b tempest-VolumesTestJSON-364947799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:13:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0db5a91a-0923-4329-b645-859ecad37b5b tempest-VolumesTestJSON-364947799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:13:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0db5a91a-0923-4329-b645-859ecad37b5b tempest-VolumesTestJSON-364947799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:07 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9 Sep 06 08:13:07 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:07 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:13:07 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:07 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e6b9230a-5a67-43fc-9d82-9122a6d47daf tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ffd571e8-e95c-4008-a70c-c0d2bfa9f475" returned: 0 in 0.428s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:07 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e6b9230a-5a67-43fc-9d82-9122a6d47daf tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-quobyte-ffd571e8-e95c-4008-a70c-c0d2bfa9f475" released by "delete_volume" :: held 1.016s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:07 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ac7c33a-3325-48ae-bc35-bc5000c811f5 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9" returned: 0 in 0.536s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ac7c33a-3325-48ae-bc35-bc5000c811f5 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:07 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6 Sep 06 08:13:07 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:07 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-e6b9230a-5a67-43fc-9d82-9122a6d47daf tempest-CreateVolumesFromSnapshotTest-1396099469 None] Created reservations ['5b8ccdbb-df33-4fd5-8573-cda26d7f69a7', 'e9c43947-5d80-4830-8b51-c6155abcc80d', 'e5f0141b-cfe8-47b4-8a9b-677995cd9e5b', '412a6b54-1c7c-4a36-8a5f-29a2e33f8efb'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:13:08 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0db5a91a-0923-4329-b645-859ecad37b5b tempest-VolumesTestJSON-364947799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.563s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:08 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-0db5a91a-0923-4329-b645-859ecad37b5b tempest-VolumesTestJSON-364947799 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:13:08 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-0db5a91a-0923-4329-b645-859ecad37b5b tempest-VolumesTestJSON-364947799 None] Deleted volume successfully. Sep 06 08:13:08 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0db5a91a-0923-4329-b645-859ecad37b5b tempest-VolumesTestJSON-364947799 None] Lock "cinder-edc262a8-3aae-44bb-9b9d-910cd13bebe2-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e6b9230a-5a67-43fc-9d82-9122a6d47daf tempest-CreateVolumesFromSnapshotTest-1396099469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:13:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e6b9230a-5a67-43fc-9d82-9122a6d47daf tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:13:08 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e6b9230a-5a67-43fc-9d82-9122a6d47daf tempest-CreateVolumesFromSnapshotTest-1396099469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:13:08 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e6b9230a-5a67-43fc-9d82-9122a6d47daf tempest-CreateVolumesFromSnapshotTest-1396099469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:13:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e6b9230a-5a67-43fc-9d82-9122a6d47daf tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:13:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e6b9230a-5a67-43fc-9d82-9122a6d47daf tempest-CreateVolumesFromSnapshotTest-1396099469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:08 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:13:08 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:08 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e6b9230a-5a67-43fc-9d82-9122a6d47daf tempest-CreateVolumesFromSnapshotTest-1396099469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.346s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:08 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-e6b9230a-5a67-43fc-9d82-9122a6d47daf tempest-CreateVolumesFromSnapshotTest-1396099469 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:13:08 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ac7c33a-3325-48ae-bc35-bc5000c811f5 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6" returned: 0 in 0.620s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ac7c33a-3325-48ae-bc35-bc5000c811f5 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:08 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e6b9230a-5a67-43fc-9d82-9122a6d47daf tempest-CreateVolumesFromSnapshotTest-1396099469 None] Deleted volume successfully. Sep 06 08:13:08 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6 Sep 06 08:13:08 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:08 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e6b9230a-5a67-43fc-9d82-9122a6d47daf tempest-CreateVolumesFromSnapshotTest-1396099469 None] Lock "cinder-ffd571e8-e95c-4008-a70c-c0d2bfa9f475-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:08 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ac7c33a-3325-48ae-bc35-bc5000c811f5 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9.7f69537c-5a23-455b-9df4-ea9402187bb6" returned: 0 in 0.370s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:08 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ac7c33a-3325-48ae-bc35-bc5000c811f5 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "cinder-quobyte-7f69537c-5a23-455b-9df4-ea9402187bb6" released by "_delete_snapshot" :: held 2.234s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:08 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ac7c33a-3325-48ae-bc35-bc5000c811f5 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "cinder-quobyte-2ce06588-50c0-4e5d-a664-7b15015920c9" released by "delete_snapshot" :: held 2.279s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:09 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-0ac7c33a-3325-48ae-bc35-bc5000c811f5 tempest-VolumesSnapshotListTestJSON-1139688237 None] Created reservations ['cd5e155a-07ab-4c1d-8ffb-6f028df66484', 'ddb54ece-74ce-4351-9bfc-c4c9af92b310', 'f31aba4c-c4d1-46d4-8bbf-986efeb515a8', '1a784422-94a3-41bb-ac41-6a330c78b0e9'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:13:09 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-0ac7c33a-3325-48ae-bc35-bc5000c811f5 tempest-VolumesSnapshotListTestJSON-1139688237 None] Delete snapshot completed successfully. Sep 06 08:13:09 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ac7c33a-3325-48ae-bc35-bc5000c811f5 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "cinder-7f69537c-5a23-455b-9df4-ea9402187bb6-delete_snapshot" released by "delete_snapshot" :: held 2.566s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:09 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-59830d77-a564-459f-b5c3-073410f0ab84 tempest-VolumesSnapshotListTestJSON-1139688237 None] Acquiring lock "cinder-2ce06588-50c0-4e5d-a664-7b15015920c9-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:13:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-59830d77-a564-459f-b5c3-073410f0ab84 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "cinder-2ce06588-50c0-4e5d-a664-7b15015920c9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-59830d77-a564-459f-b5c3-073410f0ab84 tempest-VolumesSnapshotListTestJSON-1139688237 None] Acquiring lock "cinder-quobyte-2ce06588-50c0-4e5d-a664-7b15015920c9" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:13:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-59830d77-a564-459f-b5c3-073410f0ab84 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "cinder-quobyte-2ce06588-50c0-4e5d-a664-7b15015920c9" acquired by "delete_volume" :: waited 0.026s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:10 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f217a6a-daae-4502-a51a-48e399eb3e93]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:13:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-59830d77-a564-459f-b5c3-073410f0ab84 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:10 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9 Sep 06 08:13:10 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:10 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-59830d77-a564-459f-b5c3-073410f0ab84 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9" returned: 0 in 0.581s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-59830d77-a564-459f-b5c3-073410f0ab84 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:10 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9 Sep 06 08:13:10 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:11 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-59830d77-a564-459f-b5c3-073410f0ab84 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2ce06588-50c0-4e5d-a664-7b15015920c9" returned: 0 in 0.291s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:11 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-59830d77-a564-459f-b5c3-073410f0ab84 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "cinder-quobyte-2ce06588-50c0-4e5d-a664-7b15015920c9" released by "delete_volume" :: held 0.971s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:11 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-59830d77-a564-459f-b5c3-073410f0ab84 tempest-VolumesSnapshotListTestJSON-1139688237 None] Created reservations ['a91fa212-ce67-407c-acbf-be78e65d62c7', '12a32b65-6a86-4d49-af42-b27303d4556f', 'ca465351-dd12-40bf-a952-13d987bbc6c8', '6556d6cd-4913-468c-b638-2fa6bc721b83'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:13:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-59830d77-a564-459f-b5c3-073410f0ab84 tempest-VolumesSnapshotListTestJSON-1139688237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:13:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-59830d77-a564-459f-b5c3-073410f0ab84 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:13:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-59830d77-a564-459f-b5c3-073410f0ab84 tempest-VolumesSnapshotListTestJSON-1139688237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:13:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-59830d77-a564-459f-b5c3-073410f0ab84 tempest-VolumesSnapshotListTestJSON-1139688237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:13:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-59830d77-a564-459f-b5c3-073410f0ab84 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:13:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-59830d77-a564-459f-b5c3-073410f0ab84 tempest-VolumesSnapshotListTestJSON-1139688237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:11 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:13:11 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:11 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-59830d77-a564-459f-b5c3-073410f0ab84 tempest-VolumesSnapshotListTestJSON-1139688237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.422s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:11 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-59830d77-a564-459f-b5c3-073410f0ab84 tempest-VolumesSnapshotListTestJSON-1139688237 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:13:11 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-59830d77-a564-459f-b5c3-073410f0ab84 tempest-VolumesSnapshotListTestJSON-1139688237 None] Deleted volume successfully. Sep 06 08:13:11 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-59830d77-a564-459f-b5c3-073410f0ab84 tempest-VolumesSnapshotListTestJSON-1139688237 None] Lock "cinder-2ce06588-50c0-4e5d-a664-7b15015920c9-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:18 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:13:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Flow 'volume_create_manager' (af85985d-4203-4321-90dc-7c9e1a12aba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:13:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cabc80ab-b1d4-4733-8729-49d08af76b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cabc80ab-b1d4-4733-8729-49d08af76b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1178289945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b884c90a-03c4-4ef6-ad96-9c7d8aa891c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='988554af02e44abe97dbb30777ca4dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:13:18Z,use_quota=True,user_id='e1d7a652374d4f2b9db9358af090a9f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e655bc5-9cb0-4aee-be77-9b172d880de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e655bc5-9cb0-4aee-be77-9b172d880de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249aefb2-f554-4f0f-b2d2-1ba9a2b154a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249aefb2-f554-4f0f-b2d2-1ba9a2b154a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b884c90a-03c4-4ef6-ad96-9c7d8aa891c9', 'volume_name': 'volume-b884c90a-03c4-4ef6-ad96-9c7d8aa891c9', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa08705-e01f-49b0-99c2-edabf7c59443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa08705-e01f-49b0-99c2-edabf7c59443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed84aefa-4b6c-426e-a16b-6c8204707815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:18 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Volume b884c90a-03c4-4ef6-ad96-9c7d8aa891c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b884c90a-03c4-4ef6-ad96-9c7d8aa891c9', 'volume_size': 1} Sep 06 08:13:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:13:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:13:18 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1178289945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b884c90a-03c4-4ef6-ad96-9c7d8aa891c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='988554af02e44abe97dbb30777ca4dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:13:18Z,use_quota=True,user_id='e1d7a652374d4f2b9db9358af090a9f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:13:18 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Creating volume b884c90a-03c4-4ef6-ad96-9c7d8aa891c9 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:13:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:13:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:13:18 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:13:18 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:13:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:13:18 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:13:18 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:13:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b884c90a-03c4-4ef6-ad96-9c7d8aa891c9 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:18 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b884c90a-03c4-4ef6-ad96-9c7d8aa891c9 1073741824 Sep 06 08:13:18 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:19 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b884c90a-03c4-4ef6-ad96-9c7d8aa891c9 1073741824" returned: 0 in 0.587s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b884c90a-03c4-4ef6-ad96-9c7d8aa891c9 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:19 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b884c90a-03c4-4ef6-ad96-9c7d8aa891c9 Sep 06 08:13:19 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:19 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b884c90a-03c4-4ef6-ad96-9c7d8aa891c9" returned: 0 in 0.356s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:13:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:13:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed84aefa-4b6c-426e-a16b-6c8204707815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b884c90a-03c4-4ef6-ad96-9c7d8aa891c9', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0dfc591-fdd9-446e-9d00-6ac56ccea826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:19 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Volume volume-b884c90a-03c4-4ef6-ad96-9c7d8aa891c9 (b884c90a-03c4-4ef6-ad96-9c7d8aa891c9): created successfully Sep 06 08:13:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0dfc591-fdd9-446e-9d00-6ac56ccea826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Flow 'volume_create_manager' (af85985d-4203-4321-90dc-7c9e1a12aba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:13:19 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-792411d3-680a-49cc-961c-6b482770875d tempest-TestMinimumBasicScenario-475495606 None] Created volume successfully. Sep 06 08:13:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-3b450e19-4779-4b7e-8e56-0114608f678f req-5793de6f-c146-4349-ac75-ad25245e7b46 tempest-TestMinimumBasicScenario-475495606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:13:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-3b450e19-4779-4b7e-8e56-0114608f678f req-5793de6f-c146-4349-ac75-ad25245e7b46 tempest-TestMinimumBasicScenario-475495606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:13:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-3b450e19-4779-4b7e-8e56-0114608f678f req-5793de6f-c146-4349-ac75-ad25245e7b46 tempest-TestMinimumBasicScenario-475495606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:13:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-3b450e19-4779-4b7e-8e56-0114608f678f req-5793de6f-c146-4349-ac75-ad25245e7b46 tempest-TestMinimumBasicScenario-475495606 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0', 'name': 'volume-b884c90a-03c4-4ef6-ad96-9c7d8aa891c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a89bbcff-9cc6-46a1-a039-ab899e1bc02f', 'enforce_multipath': True} {{(pid=87307) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 08:13:22 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-3b450e19-4779-4b7e-8e56-0114608f678f req-5793de6f-c146-4349-ac75-ad25245e7b46 tempest-TestMinimumBasicScenario-475495606 None] attachment_update completed successfully. Sep 06 08:13:32 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:UPDATE=125,cinder:DELETE=6,cinder:SELECT=93,cinder:INSERT=31 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:13:32 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=92,cinder:INSERT=33,cinder:UPDATE=128,cinder:DELETE=14 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:13:35 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:13:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Flow 'volume_create_manager' (af51f548-9a94-442a-a07d-dfc776ed9fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:13:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e9b681-abb8-43c7-a565-48488de00303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e9b681-abb8-43c7-a565-48488de00303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1958647821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2566897a-5342-4ffd-8a05-4a51decf4e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7747473215364658b0f4071a6afa05eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:13:35Z,use_quota=True,user_id='8f1837c3839f4d26becd2e64f9507f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9861e973-398d-45fa-82d5-62cb0643980d),volume_type_id=9861e973-398d-45fa-82d5-62cb0643980d)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6251c535-c015-4b15-9087-f408f30a8a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6251c535-c015-4b15-9087-f408f30a8a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ebf166-d1c7-4da8-a437-4aaa9b9291e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ebf166-d1c7-4da8-a437-4aaa9b9291e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2566897a-5342-4ffd-8a05-4a51decf4e9c', 'volume_name': 'volume-2566897a-5342-4ffd-8a05-4a51decf4e9c', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce04f968-f2d1-4ff1-b220-ce9cfd81aab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce04f968-f2d1-4ff1-b220-ce9cfd81aab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76f0d8b-9838-45ff-ac24-696d7f742d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:35 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Volume 2566897a-5342-4ffd-8a05-4a51decf4e9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2566897a-5342-4ffd-8a05-4a51decf4e9c', 'volume_size': 1} Sep 06 08:13:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:13:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:13:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1958647821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2566897a-5342-4ffd-8a05-4a51decf4e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7747473215364658b0f4071a6afa05eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:13:35Z,use_quota=True,user_id='8f1837c3839f4d26becd2e64f9507f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9861e973-398d-45fa-82d5-62cb0643980d),volume_type_id=9861e973-398d-45fa-82d5-62cb0643980d)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:13:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Creating volume 2566897a-5342-4ffd-8a05-4a51decf4e9c {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:13:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:13:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:13:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:13:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:13:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:13:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:13:35 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:13:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2566897a-5342-4ffd-8a05-4a51decf4e9c 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:35 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2566897a-5342-4ffd-8a05-4a51decf4e9c 1073741824 Sep 06 08:13:35 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:35 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2566897a-5342-4ffd-8a05-4a51decf4e9c 1073741824" returned: 0 in 0.634s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2566897a-5342-4ffd-8a05-4a51decf4e9c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:35 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2566897a-5342-4ffd-8a05-4a51decf4e9c Sep 06 08:13:35 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:36 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2566897a-5342-4ffd-8a05-4a51decf4e9c" returned: 0 in 0.326s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:36 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:13:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:13:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76f0d8b-9838-45ff-ac24-696d7f742d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2566897a-5342-4ffd-8a05-4a51decf4e9c', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e11eb65-7df8-431c-a6fb-f8341df90f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:36 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Volume volume-2566897a-5342-4ffd-8a05-4a51decf4e9c (2566897a-5342-4ffd-8a05-4a51decf4e9c): created successfully Sep 06 08:13:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e11eb65-7df8-431c-a6fb-f8341df90f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Flow 'volume_create_manager' (af51f548-9a94-442a-a07d-dfc776ed9fce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:13:36 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-cc009f0a-e7ce-41e9-9eff-5c8dcdb0df8b tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Created volume successfully. Sep 06 08:13:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9e4068de-9d13-4204-a991-5e7c5de9137a tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:13:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9e4068de-9d13-4204-a991-5e7c5de9137a tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:13:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9e4068de-9d13-4204-a991-5e7c5de9137a tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:13:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9e4068de-9d13-4204-a991-5e7c5de9137a tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:13:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9e4068de-9d13-4204-a991-5e7c5de9137a tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:13:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9e4068de-9d13-4204-a991-5e7c5de9137a tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:37 devstack sudo[100164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:13:37 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:38 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9e4068de-9d13-4204-a991-5e7c5de9137a tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.258s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:38 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-9e4068de-9d13-4204-a991-5e7c5de9137a tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:13:38 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-9e4068de-9d13-4204-a991-5e7c5de9137a tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Retype volume completed successfully. Sep 06 08:13:39 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7359a590-40d5-4432-94ac-851c49b19bfc tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Acquiring lock "cinder-2566897a-5342-4ffd-8a05-4a51decf4e9c-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:13:39 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7359a590-40d5-4432-94ac-851c49b19bfc tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Lock "cinder-2566897a-5342-4ffd-8a05-4a51decf4e9c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:39 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7359a590-40d5-4432-94ac-851c49b19bfc tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Acquiring lock "cinder-quobyte-2566897a-5342-4ffd-8a05-4a51decf4e9c" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:13:39 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7359a590-40d5-4432-94ac-851c49b19bfc tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Lock "cinder-quobyte-2566897a-5342-4ffd-8a05-4a51decf4e9c" acquired by "delete_volume" :: waited 0.026s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:13:39 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[68185813-f607-4148-99dd-a69cf05c170d]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:13:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7359a590-40d5-4432-94ac-851c49b19bfc tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2566897a-5342-4ffd-8a05-4a51decf4e9c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:39 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2566897a-5342-4ffd-8a05-4a51decf4e9c Sep 06 08:13:39 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:39 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7359a590-40d5-4432-94ac-851c49b19bfc tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2566897a-5342-4ffd-8a05-4a51decf4e9c" returned: 0 in 0.474s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7359a590-40d5-4432-94ac-851c49b19bfc tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2566897a-5342-4ffd-8a05-4a51decf4e9c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:39 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2566897a-5342-4ffd-8a05-4a51decf4e9c Sep 06 08:13:39 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:40 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7359a590-40d5-4432-94ac-851c49b19bfc tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2566897a-5342-4ffd-8a05-4a51decf4e9c" returned: 0 in 0.318s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7359a590-40d5-4432-94ac-851c49b19bfc tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Lock "cinder-quobyte-2566897a-5342-4ffd-8a05-4a51decf4e9c" released by "delete_volume" :: held 0.849s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:40 devstack cinder-volume[87307]: WARNING cinder.quota [None req-7359a590-40d5-4432-94ac-851c49b19bfc tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:13:40 devstack cinder-volume[87307]: WARNING cinder.quota [None req-7359a590-40d5-4432-94ac-851c49b19bfc tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:13:40 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-7359a590-40d5-4432-94ac-851c49b19bfc tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Created reservations ['9f6f7b36-d01a-404a-b081-9af9057f1bfa', 'f17b7b3b-661f-451f-b6e2-26dbb94ee6e1', '5508156a-0991-46eb-b9e8-1cee9bb9feb4', 'b2c33002-fa20-44a0-8c95-64489bab6c70'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:13:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7359a590-40d5-4432-94ac-851c49b19bfc tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:13:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7359a590-40d5-4432-94ac-851c49b19bfc tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:13:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7359a590-40d5-4432-94ac-851c49b19bfc tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:13:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7359a590-40d5-4432-94ac-851c49b19bfc tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:13:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7359a590-40d5-4432-94ac-851c49b19bfc tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:13:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7359a590-40d5-4432-94ac-851c49b19bfc tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:40 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:13:40 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:40 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7359a590-40d5-4432-94ac-851c49b19bfc tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.393s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:40 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-7359a590-40d5-4432-94ac-851c49b19bfc tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:13:40 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-7359a590-40d5-4432-94ac-851c49b19bfc tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Deleted volume successfully. Sep 06 08:13:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7359a590-40d5-4432-94ac-851c49b19bfc tempest-VolumeRetypeWithoutMigrationTest-2013742516 None] Lock "cinder-2566897a-5342-4ffd-8a05-4a51decf4e9c-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Flow 'volume_create_manager' (b4bef250-7889-4537-acbe-9cb51a2ad99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78df562-7372-4cbb-b0be-4b87a6bbfb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78df562-7372-4cbb-b0be-4b87a6bbfb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-832053958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05544a28-eb4c-4b81-8e8c-5678299d4f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0597681fdf8428b987d928d519c53d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:13:44Z,use_quota=True,user_id='2c59aa001cef45158ed674f6216e35e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2cb87ea3-6429-4116-b636-ff10076bca6e),volume_type_id=2cb87ea3-6429-4116-b636-ff10076bca6e)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afdcfae7-1585-4923-b756-4786bcf46a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afdcfae7-1585-4923-b756-4786bcf46a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64675e5-f60e-4ce0-b779-bb9431e86e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64675e5-f60e-4ce0-b779-bb9431e86e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05544a28-eb4c-4b81-8e8c-5678299d4f4d', 'volume_name': 'volume-05544a28-eb4c-4b81-8e8c-5678299d4f4d', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4d1482-c13a-4927-88cc-794fb43397c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4d1482-c13a-4927-88cc-794fb43397c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a025e95a-09cf-4486-89fd-a860969ae13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:44 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Volume 05544a28-eb4c-4b81-8e8c-5678299d4f4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05544a28-eb4c-4b81-8e8c-5678299d4f4d', 'volume_size': 1} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-832053958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05544a28-eb4c-4b81-8e8c-5678299d4f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0597681fdf8428b987d928d519c53d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:13:44Z,use_quota=True,user_id='2c59aa001cef45158ed674f6216e35e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2cb87ea3-6429-4116-b636-ff10076bca6e),volume_type_id=2cb87ea3-6429-4116-b636-ff10076bca6e)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Creating volume 05544a28-eb4c-4b81-8e8c-5678299d4f4d {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:13:44 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-05544a28-eb4c-4b81-8e8c-5678299d4f4d 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:44 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-05544a28-eb4c-4b81-8e8c-5678299d4f4d 1073741824 Sep 06 08:13:44 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Flow 'volume_create_manager' (67a5442a-84c1-4317-a60b-0e830bcf7aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d0528d-6009-4dde-ade5-9eec530d9faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d0528d-6009-4dde-ade5-9eec530d9faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2065204439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7fa4bb2-2831-4b65-a78d-a4da67643180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0597681fdf8428b987d928d519c53d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:13:45Z,use_quota=True,user_id='2c59aa001cef45158ed674f6216e35e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f630f513-9e1f-4966-a96b-55855fac5527),volume_type_id=f630f513-9e1f-4966-a96b-55855fac5527)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed61ae96-3c3b-4bc1-a65d-bd9d2f9f4d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed61ae96-3c3b-4bc1-a65d-bd9d2f9f4d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4ced5b-3a84-474b-9140-8e701f3ac933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4ced5b-3a84-474b-9140-8e701f3ac933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7fa4bb2-2831-4b65-a78d-a4da67643180', 'volume_name': 'volume-a7fa4bb2-2831-4b65-a78d-a4da67643180', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9fbec6f-0d4b-42ab-8527-fb2d72afe90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9fbec6f-0d4b-42ab-8527-fb2d72afe90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e6c9a49-9f6c-493a-a947-5e33a5681029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:44 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Volume a7fa4bb2-2831-4b65-a78d-a4da67643180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7fa4bb2-2831-4b65-a78d-a4da67643180', 'volume_size': 1} Sep 06 08:13:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:13:45 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-05544a28-eb4c-4b81-8e8c-5678299d4f4d 1073741824" returned: 0 in 0.741s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-05544a28-eb4c-4b81-8e8c-5678299d4f4d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:45 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-05544a28-eb4c-4b81-8e8c-5678299d4f4d Sep 06 08:13:45 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:45 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-05544a28-eb4c-4b81-8e8c-5678299d4f4d" returned: 0 in 0.408s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:13:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:13:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.708s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:13:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2065204439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7fa4bb2-2831-4b65-a78d-a4da67643180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0597681fdf8428b987d928d519c53d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:13:45Z,use_quota=True,user_id='2c59aa001cef45158ed674f6216e35e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f630f513-9e1f-4966-a96b-55855fac5527),volume_type_id=f630f513-9e1f-4966-a96b-55855fac5527)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:13:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Creating volume a7fa4bb2-2831-4b65-a78d-a4da67643180 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:13:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:13:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:13:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:13:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:13:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:13:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:13:45 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:13:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a7fa4bb2-2831-4b65-a78d-a4da67643180 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:45 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a7fa4bb2-2831-4b65-a78d-a4da67643180 1073741824 Sep 06 08:13:45 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a025e95a-09cf-4486-89fd-a860969ae13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05544a28-eb4c-4b81-8e8c-5678299d4f4d', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf0f0e6-93b5-420b-8cd7-e669578a2f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:45 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Volume volume-05544a28-eb4c-4b81-8e8c-5678299d4f4d (05544a28-eb4c-4b81-8e8c-5678299d4f4d): created successfully Sep 06 08:13:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf0f0e6-93b5-420b-8cd7-e669578a2f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Flow 'volume_create_manager' (b4bef250-7889-4537-acbe-9cb51a2ad99f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:13:45 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-c16741c5-a5d1-4a3b-a366-57d050e3a596 tempest-TestInstancesWithCinderVolumes-127884493 None] Created volume successfully. Sep 06 08:13:46 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:13:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Flow 'volume_create_manager' (3e6525ed-11d5-4368-b992-ed62cdc92488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:13:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d795a0-9ff5-4621-a2c3-441b0cf39d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d795a0-9ff5-4621-a2c3-441b0cf39d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-926897375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8f58aa-f80c-4800-8e53-2fcc5190e1f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0597681fdf8428b987d928d519c53d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:13:46Z,use_quota=True,user_id='2c59aa001cef45158ed674f6216e35e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134b1fa8-a002-4fc4-bb8d-2f8d15247e79),volume_type_id=134b1fa8-a002-4fc4-bb8d-2f8d15247e79)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (648b73a5-5c37-4929-b098-da4adb0b2457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:46 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (648b73a5-5c37-4929-b098-da4adb0b2457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c36c5ef9-2f86-406f-b83e-bb38efe371d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:46 devstack cinder-volume[87307]: DEBUG cinder.image.glance [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Creating Keystone auth plugin from conf {{(pid=87307) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 08:13:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a7fa4bb2-2831-4b65-a78d-a4da67643180 1073741824" returned: 0 in 0.739s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a7fa4bb2-2831-4b65-a78d-a4da67643180 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:46 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a7fa4bb2-2831-4b65-a78d-a4da67643180 Sep 06 08:13:46 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:46 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a7fa4bb2-2831-4b65-a78d-a4da67643180" returned: 0 in 0.364s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:13:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:13:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e6c9a49-9f6c-493a-a947-5e33a5681029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7fa4bb2-2831-4b65-a78d-a4da67643180', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (748751da-779d-4c3b-873c-96f5de777b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:46 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Volume volume-a7fa4bb2-2831-4b65-a78d-a4da67643180 (a7fa4bb2-2831-4b65-a78d-a4da67643180): created successfully Sep 06 08:13:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (748751da-779d-4c3b-873c-96f5de777b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Flow 'volume_create_manager' (67a5442a-84c1-4317-a60b-0e830bcf7aaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:13:46 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e5f61a1b-dde5-4865-b358-4506f02894e0 tempest-TestInstancesWithCinderVolumes-127884493 None] Created volume successfully. Sep 06 08:13:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c36c5ef9-2f86-406f-b83e-bb38efe371d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aa8f58aa-f80c-4800-8e53-2fcc5190e1f3', 'volume_name': 'volume-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3', 'volume_size': 1, 'image_id': '2525a5ec-f711-4128-a9c0-e2a36c6299cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2525a5ec-f711-4128-a9c0-e2a36c6299cf', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--885869096', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0597681fdf8428b987d928d519c53d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2525a5ec-f711-4128-a9c0-e2a36c6299cf', 'created_at': datetime.datetime(2026, 9, 6, 6, 13, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 6, 13, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2525a5ec-f711-4128-a9c0-e2a36c6299cf/file', 'properties': {}}, 'image_service': }' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f020878-cb9d-4383-a7a0-de6b878fc0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f020878-cb9d-4383-a7a0-de6b878fc0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a84349e3-3712-45ee-9c40-49b87901a5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:46 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Volume aa8f58aa-f80c-4800-8e53-2fcc5190e1f3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3', 'volume_size': 1, 'image_id': '2525a5ec-f711-4128-a9c0-e2a36c6299cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2525a5ec-f711-4128-a9c0-e2a36c6299cf', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--885869096', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0597681fdf8428b987d928d519c53d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2525a5ec-f711-4128-a9c0-e2a36c6299cf', 'created_at': datetime.datetime(2026, 9, 6, 6, 13, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 6, 13, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2525a5ec-f711-4128-a9c0-e2a36c6299cf/file', 'properties': {}}, 'image_service': } Sep 06 08:13:46 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Trying to clone aa8f58aa-f80c-4800-8e53-2fcc5190e1f3 from image 2525a5ec-f711-4128-a9c0-e2a36c6299cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/2525a5ec-f711-4128-a9c0-e2a36c6299cf', 'metadata': {}}]). {{(pid=87307) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 08:13:50 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2525a5ec-f711-4128-a9c0-e2a36c6299cf_tih36yu0devstack@QuobyteHD, size 20.69 MB, duration 3.96 sec {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 08:13:50 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Image download 20.69 MB at 5.22 MB/s Sep 06 08:13:50 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[523fff32-9de1-45c5-80d6-923acbdf5268]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:13:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2525a5ec-f711-4128-a9c0-e2a36c6299cf_tih36yu0devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:51 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2525a5ec-f711-4128-a9c0-e2a36c6299cf_tih36yu0devstack@QuobyteHD Sep 06 08:13:51 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:51 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2525a5ec-f711-4128-a9c0-e2a36c6299cf_tih36yu0devstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:51 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Temporary image 2525a5ec-f711-4128-a9c0-e2a36c6299cf is fetched for user 2c59aa001cef45158ed674f6216e35e6. {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 08:13:51 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a6c26a-d730-4ba6-9120-8523fa8196d8]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:13:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2525a5ec-f711-4128-a9c0-e2a36c6299cf_tih36yu0devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:51 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2525a5ec-f711-4128-a9c0-e2a36c6299cf_tih36yu0devstack@QuobyteHD Sep 06 08:13:51 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:51 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2525a5ec-f711-4128-a9c0-e2a36c6299cf_tih36yu0devstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:13:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:13:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-926897375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8f58aa-f80c-4800-8e53-2fcc5190e1f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0597681fdf8428b987d928d519c53d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:13:46Z,use_quota=True,user_id='2c59aa001cef45158ed674f6216e35e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134b1fa8-a002-4fc4-bb8d-2f8d15247e79),volume_type_id=134b1fa8-a002-4fc4-bb8d-2f8d15247e79)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:13:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Creating volume aa8f58aa-f80c-4800-8e53-2fcc5190e1f3 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:13:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:13:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:13:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:13:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:13:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:13:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:13:51 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:13:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:51 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3 1073741824 Sep 06 08:13:51 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:52 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3 1073741824" returned: 0 in 0.473s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:52 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3 Sep 06 08:13:52 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:52 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3" returned: 0 in 0.282s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:52 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:13:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:13:52 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Attempting download of 2525a5ec-f711-4128-a9c0-e2a36c6299cf ((None, [{'url': 'file:///opt/stack/data/glance/images/2525a5ec-f711-4128-a9c0-e2a36c6299cf', 'metadata': {}}])) to volume aa8f58aa-f80c-4800-8e53-2fcc5190e1f3. {{(pid=87307) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 08:13:52 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[effc584c-6ab4-4c11-ba71-a80ce2a8d866]: (4, 'raw') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:13:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2525a5ec-f711-4128-a9c0-e2a36c6299cf_7i48eub0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:52 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2525a5ec-f711-4128-a9c0-e2a36c6299cf_7i48eub0 Sep 06 08:13:52 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:53 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2525a5ec-f711-4128-a9c0-e2a36c6299cf_7i48eub0" returned: 0 in 0.358s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2525a5ec-f711-4128-a9c0-e2a36c6299cf_7i48eub0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:53 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2525a5ec-f711-4128-a9c0-e2a36c6299cf_7i48eub0 Sep 06 08:13:53 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:53 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2525a5ec-f711-4128-a9c0-e2a36c6299cf_7i48eub0" returned: 1 in 0.356s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2525a5ec-f711-4128-a9c0-e2a36c6299cf_7i48eub0' failed. Not Retrying. {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 08:13:53 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[85765b11-77e4-45cd-bf2c-d6b52a62c43c]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:13:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2525a5ec-f711-4128-a9c0-e2a36c6299cf_tih36yu0devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:53 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2525a5ec-f711-4128-a9c0-e2a36c6299cf_tih36yu0devstack@QuobyteHD Sep 06 08:13:53 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:53 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2525a5ec-f711-4128-a9c0-e2a36c6299cf_tih36yu0devstack@QuobyteHD" returned: 0 in 0.376s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:53 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] 2525a5ec-f711-4128-a9c0-e2a36c6299cf was qcow2, converting to qcow2 {{(pid=87307) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 08:13:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2525a5ec-f711-4128-a9c0-e2a36c6299cf_tih36yu0devstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:53 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2525a5ec-f711-4128-a9c0-e2a36c6299cf_tih36yu0devstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3 Sep 06 08:13:53 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:55 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2525a5ec-f711-4128-a9c0-e2a36c6299cf_tih36yu0devstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3" returned: 0 in 2.049s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:55 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2525a5ec-f711-4128-a9c0-e2a36c6299cf_tih36yu0devstack@QuobyteHD, size 112.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3 {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:13:55 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Converted 112.00 MB image at 54.61 MB/s Sep 06 08:13:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:55 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3 1G Sep 06 08:13:55 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:13:56 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Sep 06 08:13:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3 1G" returned: 0 in 0.358s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:13:56 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Downloaded image 2525a5ec-f711-4128-a9c0-e2a36c6299cf ((None, [{'url': 'file:///opt/stack/data/glance/images/2525a5ec-f711-4128-a9c0-e2a36c6299cf', 'metadata': {}}])) to volume aa8f58aa-f80c-4800-8e53-2fcc5190e1f3 successfully. {{(pid=87307) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 08:13:56 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Temporary image 2525a5ec-f711-4128-a9c0-e2a36c6299cf for user 2c59aa001cef45158ed674f6216e35e6 is deleted. {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 08:13:56 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Marking volume aa8f58aa-f80c-4800-8e53-2fcc5190e1f3 as bootable. {{(pid=87307) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 08:13:56 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Copying metadata from image 2525a5ec-f711-4128-a9c0-e2a36c6299cf to aa8f58aa-f80c-4800-8e53-2fcc5190e1f3. {{(pid=87307) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 08:13:56 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Creating volume glance metadata for volume aa8f58aa-f80c-4800-8e53-2fcc5190e1f3 backed by image 2525a5ec-f711-4128-a9c0-e2a36c6299cf with: {'image_id': '2525a5ec-f711-4128-a9c0-e2a36c6299cf', 'image_name': 'tempest-scenario-img--885869096', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87307) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 08:13:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a84349e3-3712-45ee-9c40-49b87901a5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3', 'volume_size': 1, 'image_id': '2525a5ec-f711-4128-a9c0-e2a36c6299cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2525a5ec-f711-4128-a9c0-e2a36c6299cf', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--885869096', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0597681fdf8428b987d928d519c53d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2525a5ec-f711-4128-a9c0-e2a36c6299cf', 'created_at': datetime.datetime(2026, 9, 6, 6, 13, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 6, 13, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2525a5ec-f711-4128-a9c0-e2a36c6299cf/file', 'properties': {}}, 'image_service': }' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03850007-94ae-49fc-90f8-6f5bec839a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:13:56 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Volume volume-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3 (aa8f58aa-f80c-4800-8e53-2fcc5190e1f3): created successfully Sep 06 08:13:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03850007-94ae-49fc-90f8-6f5bec839a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:13:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Flow 'volume_create_manager' (3e6525ed-11d5-4368-b992-ed62cdc92488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:13:56 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-b7769fc0-222b-4b6d-a541-3e488b315804 tempest-TestInstancesWithCinderVolumes-127884493 None] Created volume successfully. Sep 06 08:13:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:13:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:13:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:13:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:13:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:13:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:13:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:13:59 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:13:59 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:00 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.365s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:00 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:14:00 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager._thread_info {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:14:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread count: 28 {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 08:14:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread info: [<_MainThread(MainThread, started 139985167040640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:14:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-de793fcb-7cb2-4a46-aae6-503d53d8aaa8 req-7dcd2f7e-fdcd-43cc-a3d6-5b9a25529008 tempest-TestInstancesWithCinderVolumes-127884493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:14:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-de793fcb-7cb2-4a46-aae6-503d53d8aaa8 req-7dcd2f7e-fdcd-43cc-a3d6-5b9a25529008 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:14:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-de793fcb-7cb2-4a46-aae6-503d53d8aaa8 req-7dcd2f7e-fdcd-43cc-a3d6-5b9a25529008 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:14:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-de793fcb-7cb2-4a46-aae6-503d53d8aaa8 req-7dcd2f7e-fdcd-43cc-a3d6-5b9a25529008 tempest-TestInstancesWithCinderVolumes-127884493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0', 'name': 'volume-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3b3dede-b8ea-4806-a5af-b3db8ce37457', 'enforce_multipath': True} {{(pid=87307) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 08:14:00 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-de793fcb-7cb2-4a46-aae6-503d53d8aaa8 req-7dcd2f7e-fdcd-43cc-a3d6-5b9a25529008 tempest-TestInstancesWithCinderVolumes-127884493 None] attachment_update completed successfully. Sep 06 08:14:10 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=32,cinder:UPDATE=26,cinder:DELETE=5,cinder:INSERT=6 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:14:10 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=33,cinder:UPDATE=30,cinder:INSERT=11 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:14:12 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-7992b109-a848-417d-bdcb-b92742d239d9 req-6573f8ad-d18b-4698-88a1-c60a579cf4f4 tempest-TestMinimumBasicScenario-475495606 None] Terminate volume connection completed successfully. Sep 06 08:14:12 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-7992b109-a848-417d-bdcb-b92742d239d9 req-6573f8ad-d18b-4698-88a1-c60a579cf4f4 tempest-TestMinimumBasicScenario-475495606 None] Deleting attachment a89bbcff-9cc6-46a1-a039-ab899e1bc02f. {{(pid=87307) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 08:14:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e7d3ab21-e5fd-4591-862e-c52baf03be62 tempest-TestMinimumBasicScenario-475495606 None] Acquiring lock "cinder-b884c90a-03c4-4ef6-ad96-9c7d8aa891c9-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:14:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e7d3ab21-e5fd-4591-862e-c52baf03be62 tempest-TestMinimumBasicScenario-475495606 None] Lock "cinder-b884c90a-03c4-4ef6-ad96-9c7d8aa891c9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:14:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e7d3ab21-e5fd-4591-862e-c52baf03be62 tempest-TestMinimumBasicScenario-475495606 None] Acquiring lock "cinder-quobyte-b884c90a-03c4-4ef6-ad96-9c7d8aa891c9" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:14:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e7d3ab21-e5fd-4591-862e-c52baf03be62 tempest-TestMinimumBasicScenario-475495606 None] Lock "cinder-quobyte-b884c90a-03c4-4ef6-ad96-9c7d8aa891c9" acquired by "delete_volume" :: waited 0.043s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:14:13 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bea6a0d-4425-4273-b4dc-943eb8bc4380]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:14:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e7d3ab21-e5fd-4591-862e-c52baf03be62 tempest-TestMinimumBasicScenario-475495606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b884c90a-03c4-4ef6-ad96-9c7d8aa891c9 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:13 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b884c90a-03c4-4ef6-ad96-9c7d8aa891c9 Sep 06 08:14:13 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:13 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e7d3ab21-e5fd-4591-862e-c52baf03be62 tempest-TestMinimumBasicScenario-475495606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b884c90a-03c4-4ef6-ad96-9c7d8aa891c9" returned: 0 in 0.535s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e7d3ab21-e5fd-4591-862e-c52baf03be62 tempest-TestMinimumBasicScenario-475495606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b884c90a-03c4-4ef6-ad96-9c7d8aa891c9 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:13 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b884c90a-03c4-4ef6-ad96-9c7d8aa891c9 Sep 06 08:14:13 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:14 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e7d3ab21-e5fd-4591-862e-c52baf03be62 tempest-TestMinimumBasicScenario-475495606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b884c90a-03c4-4ef6-ad96-9c7d8aa891c9" returned: 0 in 0.317s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:14 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e7d3ab21-e5fd-4591-862e-c52baf03be62 tempest-TestMinimumBasicScenario-475495606 None] Lock "cinder-quobyte-b884c90a-03c4-4ef6-ad96-9c7d8aa891c9" released by "delete_volume" :: held 0.929s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:14:14 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-e7d3ab21-e5fd-4591-862e-c52baf03be62 tempest-TestMinimumBasicScenario-475495606 None] Created reservations ['9714764b-cd1b-4fd9-a8fb-85a094583adc', '7ae1360b-c9d7-4f61-8a28-1d583d6ea2e1', 'd35e9cde-30c8-4325-a2bd-75243c55cb51', '325c56b2-1d88-4ab1-b2e0-2ab25fbc895a'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:14:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e7d3ab21-e5fd-4591-862e-c52baf03be62 tempest-TestMinimumBasicScenario-475495606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:14:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e7d3ab21-e5fd-4591-862e-c52baf03be62 tempest-TestMinimumBasicScenario-475495606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:14:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e7d3ab21-e5fd-4591-862e-c52baf03be62 tempest-TestMinimumBasicScenario-475495606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:14:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e7d3ab21-e5fd-4591-862e-c52baf03be62 tempest-TestMinimumBasicScenario-475495606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:14:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e7d3ab21-e5fd-4591-862e-c52baf03be62 tempest-TestMinimumBasicScenario-475495606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:14:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e7d3ab21-e5fd-4591-862e-c52baf03be62 tempest-TestMinimumBasicScenario-475495606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:14 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:14:14 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:14 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e7d3ab21-e5fd-4591-862e-c52baf03be62 tempest-TestMinimumBasicScenario-475495606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.447s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:14 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-e7d3ab21-e5fd-4591-862e-c52baf03be62 tempest-TestMinimumBasicScenario-475495606 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:14:14 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e7d3ab21-e5fd-4591-862e-c52baf03be62 tempest-TestMinimumBasicScenario-475495606 None] Deleted volume successfully. Sep 06 08:14:15 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e7d3ab21-e5fd-4591-862e-c52baf03be62 tempest-TestMinimumBasicScenario-475495606 None] Lock "cinder-b884c90a-03c4-4ef6-ad96-9c7d8aa891c9-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:14:24 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:14:24 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:14:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-bfef3948-2a4a-4220-b550-669645421d13 req-15b2bc4c-5e98-4ea3-a440-cec57022db5d tempest-TestInstancesWithCinderVolumes-127884493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:14:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-bfef3948-2a4a-4220-b550-669645421d13 req-15b2bc4c-5e98-4ea3-a440-cec57022db5d tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:14:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-bfef3948-2a4a-4220-b550-669645421d13 req-15b2bc4c-5e98-4ea3-a440-cec57022db5d tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:14:34 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-bfef3948-2a4a-4220-b550-669645421d13 req-15b2bc4c-5e98-4ea3-a440-cec57022db5d tempest-TestInstancesWithCinderVolumes-127884493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0', 'name': 'volume-05544a28-eb4c-4b81-8e8c-5678299d4f4d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d15550f-c8a8-4460-a53b-dae4e12a285c', 'enforce_multipath': True} {{(pid=87307) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 08:14:35 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-bfef3948-2a4a-4220-b550-669645421d13 req-15b2bc4c-5e98-4ea3-a440-cec57022db5d tempest-TestInstancesWithCinderVolumes-127884493 None] attachment_update completed successfully. Sep 06 08:14:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-fb0ad17e-18f8-4b55-a05c-0e6b06abdfe6 req-581cf94f-cbfd-4133-9de9-4f0634cee529 tempest-TestInstancesWithCinderVolumes-127884493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:14:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-fb0ad17e-18f8-4b55-a05c-0e6b06abdfe6 req-581cf94f-cbfd-4133-9de9-4f0634cee529 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:14:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-fb0ad17e-18f8-4b55-a05c-0e6b06abdfe6 req-581cf94f-cbfd-4133-9de9-4f0634cee529 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:14:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-fb0ad17e-18f8-4b55-a05c-0e6b06abdfe6 req-581cf94f-cbfd-4133-9de9-4f0634cee529 tempest-TestInstancesWithCinderVolumes-127884493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0', 'name': 'volume-a7fa4bb2-2831-4b65-a78d-a4da67643180', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '517a5e0a-93ac-460d-8f64-038fc99c6cc6', 'enforce_multipath': True} {{(pid=87307) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 08:14:37 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-fb0ad17e-18f8-4b55-a05c-0e6b06abdfe6 req-581cf94f-cbfd-4133-9de9-4f0634cee529 tempest-TestInstancesWithCinderVolumes-127884493 None] attachment_update completed successfully. Sep 06 08:14:41 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:14:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Flow 'volume_create_manager' (a6e8a061-1bf9-4b8f-9f2a-5fd0e05c7a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:14:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286554eb-04b0-4675-ac0e-c77c7edfa909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:14:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286554eb-04b0-4675-ac0e-c77c7edfa909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1093501533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb234c4b05648f6945f0914e9e29e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:14:42Z,use_quota=True,user_id='260b36739ad2454eb43af2df70174f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:14:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50009b0e-d564-42ed-bae7-395242db1898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:14:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50009b0e-d564-42ed-bae7-395242db1898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:14:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e55b0b-69b0-484d-9adf-7521b6851547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:14:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e55b0b-69b0-484d-9adf-7521b6851547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea', 'volume_name': 'volume-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:14:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e37370c-e6fd-48e6-8f36-54ff37138daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:14:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e37370c-e6fd-48e6-8f36-54ff37138daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:14:41 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dba2919-7eaa-460f-9670-6735371f331a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:14:41 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Volume 9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea', 'volume_size': 1} Sep 06 08:14:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:14:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:14:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1093501533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb234c4b05648f6945f0914e9e29e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:14:42Z,use_quota=True,user_id='260b36739ad2454eb43af2df70174f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:14:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Creating volume 9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:14:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:14:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:14:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:14:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:14:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:14:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:14:41 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:14:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:41 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea 1073741824 Sep 06 08:14:41 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:42 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea 1073741824" returned: 0 in 0.566s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:42 devstack sudo[100655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea Sep 06 08:14:42 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:42 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea" returned: 0 in 0.335s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:14:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:14:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dba2919-7eaa-460f-9670-6735371f331a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:14:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4ebdf7-0547-4fc5-b2a3-8b2fbbd53705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:14:42 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Volume volume-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea (9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea): created successfully Sep 06 08:14:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4ebdf7-0547-4fc5-b2a3-8b2fbbd53705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:14:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Flow 'volume_create_manager' (a6e8a061-1bf9-4b8f-9f2a-5fd0e05c7a8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:14:42 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e4ee69f5-3378-4932-83dd-f23cfa76088c tempest-VolumesActionsTest-1702047703 None] Created volume successfully. Sep 06 08:14:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f0fea527-cb40-4e64-b1e1-0495117111a2 tempest-VolumesActionsTest-1702047703 None] Acquiring lock "cinder-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea" by "attach_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:14:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f0fea527-cb40-4e64-b1e1-0495117111a2 tempest-VolumesActionsTest-1702047703 None] Lock "cinder-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea" acquired by "attach_volume" :: waited 0.028s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:14:43 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f0fea527-cb40-4e64-b1e1-0495117111a2 tempest-VolumesActionsTest-1702047703 None] Attaching volume 9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea to instance a953e9b7-f696-4657-ac4c-a925e50242cb at mountpoint /dev/vdb on host None. Sep 06 08:14:43 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f0fea527-cb40-4e64-b1e1-0495117111a2 tempest-VolumesActionsTest-1702047703 None] Attach volume completed successfully. Sep 06 08:14:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f0fea527-cb40-4e64-b1e1-0495117111a2 tempest-VolumesActionsTest-1702047703 None] Lock "cinder-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea" released by "attach_volume" :: held 0.132s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:14:44 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-65f9cb6f-5a63-4534-bbe0-b78693b7365d req-6b4ecdc6-24e6-42ef-9f32-b0cacbb61fee tempest-TestInstancesWithCinderVolumes-127884493 None] Terminate volume connection completed successfully. Sep 06 08:14:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-65f9cb6f-5a63-4534-bbe0-b78693b7365d req-6b4ecdc6-24e6-42ef-9f32-b0cacbb61fee tempest-TestInstancesWithCinderVolumes-127884493 None] Deleting attachment 2d15550f-c8a8-4460-a53b-dae4e12a285c. {{(pid=87307) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 08:14:44 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-ed463e0b-0337-4798-84e6-1fab268d7a34 tempest-VolumesActionsTest-779208237 None] Terminate volume connection completed successfully. Sep 06 08:14:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ed463e0b-0337-4798-84e6-1fab268d7a34 tempest-VolumesActionsTest-779208237 None] Acquiring lock "cinder-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea-detach_volume" by "detach_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:14:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ed463e0b-0337-4798-84e6-1fab268d7a34 tempest-VolumesActionsTest-779208237 None] Lock "cinder-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:14:44 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-ed463e0b-0337-4798-84e6-1fab268d7a34 tempest-VolumesActionsTest-779208237 None] Detaching volume 9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea from instance a953e9b7-f696-4657-ac4c-a925e50242cb. Sep 06 08:14:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-35f19b94-8b04-473c-b9ac-beb730e77d77 tempest-TestInstancesWithCinderVolumes-127884493 None] Acquiring lock "cinder-05544a28-eb4c-4b81-8e8c-5678299d4f4d-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:14:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-35f19b94-8b04-473c-b9ac-beb730e77d77 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "cinder-05544a28-eb4c-4b81-8e8c-5678299d4f4d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:14:44 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-ed463e0b-0337-4798-84e6-1fab268d7a34 tempest-VolumesActionsTest-779208237 None] Detach volume completed successfully. Sep 06 08:14:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ed463e0b-0337-4798-84e6-1fab268d7a34 tempest-VolumesActionsTest-779208237 None] Lock "cinder-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea-detach_volume" released by "detach_volume" :: held 0.200s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:14:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-35f19b94-8b04-473c-b9ac-beb730e77d77 tempest-TestInstancesWithCinderVolumes-127884493 None] Acquiring lock "cinder-quobyte-05544a28-eb4c-4b81-8e8c-5678299d4f4d" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:14:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-35f19b94-8b04-473c-b9ac-beb730e77d77 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "cinder-quobyte-05544a28-eb4c-4b81-8e8c-5678299d4f4d" acquired by "delete_volume" :: waited 0.033s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:14:45 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc0f8a7-e28c-4b7a-afe2-c115a6c1faa6]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:14:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-35f19b94-8b04-473c-b9ac-beb730e77d77 tempest-TestInstancesWithCinderVolumes-127884493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-05544a28-eb4c-4b81-8e8c-5678299d4f4d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:45 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-05544a28-eb4c-4b81-8e8c-5678299d4f4d Sep 06 08:14:45 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-54b169a2-f3fa-42c7-b237-71d73cce4ef7 tempest-VolumesActionsTest-1702047703 None] Acquiring lock "cinder-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea-detach_volume" by "detach_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:14:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-54b169a2-f3fa-42c7-b237-71d73cce4ef7 tempest-VolumesActionsTest-1702047703 None] Lock "cinder-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:14:45 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-54b169a2-f3fa-42c7-b237-71d73cce4ef7 tempest-VolumesActionsTest-1702047703 None] Volume detach called, but volume not attached. Sep 06 08:14:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-54b169a2-f3fa-42c7-b237-71d73cce4ef7 tempest-VolumesActionsTest-1702047703 None] Lock "cinder-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea-detach_volume" released by "detach_volume" :: held 0.039s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:14:45 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-35f19b94-8b04-473c-b9ac-beb730e77d77 tempest-TestInstancesWithCinderVolumes-127884493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-05544a28-eb4c-4b81-8e8c-5678299d4f4d" returned: 0 in 0.651s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-35f19b94-8b04-473c-b9ac-beb730e77d77 tempest-TestInstancesWithCinderVolumes-127884493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-05544a28-eb4c-4b81-8e8c-5678299d4f4d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:45 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-05544a28-eb4c-4b81-8e8c-5678299d4f4d Sep 06 08:14:45 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a967760d-d023-4b69-bb6a-0c95dde56162 tempest-VolumesActionsTest-1702047703 None] Acquiring lock "cinder-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:14:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a967760d-d023-4b69-bb6a-0c95dde56162 tempest-VolumesActionsTest-1702047703 None] Lock "cinder-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:14:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a967760d-d023-4b69-bb6a-0c95dde56162 tempest-VolumesActionsTest-1702047703 None] Acquiring lock "cinder-quobyte-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:14:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a967760d-d023-4b69-bb6a-0c95dde56162 tempest-VolumesActionsTest-1702047703 None] Lock "cinder-quobyte-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea" acquired by "delete_volume" :: waited 0.042s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:14:46 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce057c4-abb3-47aa-a239-fa2a163bc474]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:14:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a967760d-d023-4b69-bb6a-0c95dde56162 tempest-VolumesActionsTest-1702047703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:46 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-35f19b94-8b04-473c-b9ac-beb730e77d77 tempest-TestInstancesWithCinderVolumes-127884493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-05544a28-eb4c-4b81-8e8c-5678299d4f4d" returned: 0 in 0.401s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:46 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-35f19b94-8b04-473c-b9ac-beb730e77d77 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "cinder-quobyte-05544a28-eb4c-4b81-8e8c-5678299d4f4d" released by "delete_volume" :: held 1.134s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:14:46 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea Sep 06 08:14:46 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:46 devstack cinder-volume[87307]: WARNING cinder.quota [None req-35f19b94-8b04-473c-b9ac-beb730e77d77 tempest-TestInstancesWithCinderVolumes-127884493 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1538201551-1127650089 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1538201551-1127650089, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:14:46 devstack cinder-volume[87307]: WARNING cinder.quota [None req-35f19b94-8b04-473c-b9ac-beb730e77d77 tempest-TestInstancesWithCinderVolumes-127884493 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1538201551-1127650089 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1538201551-1127650089, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:14:46 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-35f19b94-8b04-473c-b9ac-beb730e77d77 tempest-TestInstancesWithCinderVolumes-127884493 None] Created reservations ['4e2b14ff-df39-4743-940a-e65b4c97920a', '8ac01a6c-1803-4719-be95-8d0d653fd22c', 'a8e6eac9-f681-4cb3-8a3b-9badcd401453', 'ea77f4f9-ac7a-4c38-8ab5-2091d44a59e4'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:14:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-35f19b94-8b04-473c-b9ac-beb730e77d77 tempest-TestInstancesWithCinderVolumes-127884493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:14:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-35f19b94-8b04-473c-b9ac-beb730e77d77 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:14:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-35f19b94-8b04-473c-b9ac-beb730e77d77 tempest-TestInstancesWithCinderVolumes-127884493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:14:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-35f19b94-8b04-473c-b9ac-beb730e77d77 tempest-TestInstancesWithCinderVolumes-127884493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:14:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-35f19b94-8b04-473c-b9ac-beb730e77d77 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:14:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-35f19b94-8b04-473c-b9ac-beb730e77d77 tempest-TestInstancesWithCinderVolumes-127884493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:46 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:14:46 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:46 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a967760d-d023-4b69-bb6a-0c95dde56162 tempest-VolumesActionsTest-1702047703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea" returned: 0 in 0.617s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a967760d-d023-4b69-bb6a-0c95dde56162 tempest-VolumesActionsTest-1702047703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:46 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea Sep 06 08:14:46 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:46 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-35f19b94-8b04-473c-b9ac-beb730e77d77 tempest-TestInstancesWithCinderVolumes-127884493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.470s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:46 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-35f19b94-8b04-473c-b9ac-beb730e77d77 tempest-TestInstancesWithCinderVolumes-127884493 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:14:46 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-35f19b94-8b04-473c-b9ac-beb730e77d77 tempest-TestInstancesWithCinderVolumes-127884493 None] Deleted volume successfully. Sep 06 08:14:46 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a967760d-d023-4b69-bb6a-0c95dde56162 tempest-VolumesActionsTest-1702047703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea" returned: 0 in 0.352s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a967760d-d023-4b69-bb6a-0c95dde56162 tempest-VolumesActionsTest-1702047703 None] Lock "cinder-quobyte-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea" released by "delete_volume" :: held 1.086s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:14:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-35f19b94-8b04-473c-b9ac-beb730e77d77 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "cinder-05544a28-eb4c-4b81-8e8c-5678299d4f4d-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:14:47 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-a967760d-d023-4b69-bb6a-0c95dde56162 tempest-VolumesActionsTest-1702047703 None] Created reservations ['a01539b5-f035-4070-aff5-dc5b85a87507', '81551321-8c13-410a-91b8-8dfd7925f4fc', 'ec319a60-ab78-44dd-84cc-177b74276727', '70c28c95-908c-43f8-a8bc-8cc15c432ab5'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:14:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a967760d-d023-4b69-bb6a-0c95dde56162 tempest-VolumesActionsTest-1702047703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:14:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a967760d-d023-4b69-bb6a-0c95dde56162 tempest-VolumesActionsTest-1702047703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:14:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a967760d-d023-4b69-bb6a-0c95dde56162 tempest-VolumesActionsTest-1702047703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:14:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a967760d-d023-4b69-bb6a-0c95dde56162 tempest-VolumesActionsTest-1702047703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:14:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a967760d-d023-4b69-bb6a-0c95dde56162 tempest-VolumesActionsTest-1702047703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:14:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a967760d-d023-4b69-bb6a-0c95dde56162 tempest-VolumesActionsTest-1702047703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:47 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:14:47 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:47 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a967760d-d023-4b69-bb6a-0c95dde56162 tempest-VolumesActionsTest-1702047703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.368s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:47 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-a967760d-d023-4b69-bb6a-0c95dde56162 tempest-VolumesActionsTest-1702047703 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:14:47 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-a967760d-d023-4b69-bb6a-0c95dde56162 tempest-VolumesActionsTest-1702047703 None] Deleted volume successfully. Sep 06 08:14:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a967760d-d023-4b69-bb6a-0c95dde56162 tempest-VolumesActionsTest-1702047703 None] Lock "cinder-9eb7a50f-dcb6-45bc-a64e-dad2fcf3daea-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:14:50 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-a24c097a-6797-4b02-a7a5-08a01b1dc4ab req-397f8de1-ef73-4127-9195-ec522ddeb997 tempest-TestInstancesWithCinderVolumes-127884493 None] Terminate volume connection completed successfully. Sep 06 08:14:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-a24c097a-6797-4b02-a7a5-08a01b1dc4ab req-397f8de1-ef73-4127-9195-ec522ddeb997 tempest-TestInstancesWithCinderVolumes-127884493 None] Deleting attachment 517a5e0a-93ac-460d-8f64-038fc99c6cc6. {{(pid=87307) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 08:14:50 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4522f94b-2908-488f-b129-bea8cfd904bb tempest-TestInstancesWithCinderVolumes-127884493 None] Acquiring lock "cinder-a7fa4bb2-2831-4b65-a78d-a4da67643180-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:14:50 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4522f94b-2908-488f-b129-bea8cfd904bb tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "cinder-a7fa4bb2-2831-4b65-a78d-a4da67643180-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:14:50 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4522f94b-2908-488f-b129-bea8cfd904bb tempest-TestInstancesWithCinderVolumes-127884493 None] Acquiring lock "cinder-quobyte-a7fa4bb2-2831-4b65-a78d-a4da67643180" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:14:50 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4522f94b-2908-488f-b129-bea8cfd904bb tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "cinder-quobyte-a7fa4bb2-2831-4b65-a78d-a4da67643180" acquired by "delete_volume" :: waited 0.052s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:14:51 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b3d5f8-b241-4107-9a62-6820aed3d939]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:14:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4522f94b-2908-488f-b129-bea8cfd904bb tempest-TestInstancesWithCinderVolumes-127884493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a7fa4bb2-2831-4b65-a78d-a4da67643180 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:51 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a7fa4bb2-2831-4b65-a78d-a4da67643180 Sep 06 08:14:51 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:51 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4522f94b-2908-488f-b129-bea8cfd904bb tempest-TestInstancesWithCinderVolumes-127884493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a7fa4bb2-2831-4b65-a78d-a4da67643180" returned: 0 in 0.564s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4522f94b-2908-488f-b129-bea8cfd904bb tempest-TestInstancesWithCinderVolumes-127884493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a7fa4bb2-2831-4b65-a78d-a4da67643180 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:51 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a7fa4bb2-2831-4b65-a78d-a4da67643180 Sep 06 08:14:51 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:51 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4522f94b-2908-488f-b129-bea8cfd904bb tempest-TestInstancesWithCinderVolumes-127884493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a7fa4bb2-2831-4b65-a78d-a4da67643180" returned: 0 in 0.332s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:51 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4522f94b-2908-488f-b129-bea8cfd904bb tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "cinder-quobyte-a7fa4bb2-2831-4b65-a78d-a4da67643180" released by "delete_volume" :: held 0.987s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:14:52 devstack cinder-volume[87307]: WARNING cinder.quota [None req-4522f94b-2908-488f-b129-bea8cfd904bb tempest-TestInstancesWithCinderVolumes-127884493 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1760748855-1878947312 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1760748855-1878947312, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:14:52 devstack cinder-volume[87307]: WARNING cinder.quota [None req-4522f94b-2908-488f-b129-bea8cfd904bb tempest-TestInstancesWithCinderVolumes-127884493 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1760748855-1878947312 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1760748855-1878947312, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-4522f94b-2908-488f-b129-bea8cfd904bb tempest-TestInstancesWithCinderVolumes-127884493 None] Created reservations ['371b35a0-4f51-469f-ad77-43c93d33cbcc', '774eca81-0aea-492f-8654-4feabb965d60', '0b925d83-ad63-46fb-865b-5c81a17a1c5c', 'cc0f80e2-d60f-418b-9013-c5e7796d95fc'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-4522f94b-2908-488f-b129-bea8cfd904bb tempest-TestInstancesWithCinderVolumes-127884493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-4522f94b-2908-488f-b129-bea8cfd904bb tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-4522f94b-2908-488f-b129-bea8cfd904bb tempest-TestInstancesWithCinderVolumes-127884493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-4522f94b-2908-488f-b129-bea8cfd904bb tempest-TestInstancesWithCinderVolumes-127884493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-4522f94b-2908-488f-b129-bea8cfd904bb tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4522f94b-2908-488f-b129-bea8cfd904bb tempest-TestInstancesWithCinderVolumes-127884493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:52 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:14:52 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:52 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4522f94b-2908-488f-b129-bea8cfd904bb tempest-TestInstancesWithCinderVolumes-127884493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.279s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-4522f94b-2908-488f-b129-bea8cfd904bb tempest-TestInstancesWithCinderVolumes-127884493 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:14:52 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-4522f94b-2908-488f-b129-bea8cfd904bb tempest-TestInstancesWithCinderVolumes-127884493 None] Deleted volume successfully. Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4522f94b-2908-488f-b129-bea8cfd904bb tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "cinder-a7fa4bb2-2831-4b65-a78d-a4da67643180-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Flow 'volume_create_manager' (05579091-85ff-4960-b6c8-37da29a22459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a70f6b6-16cb-4314-869d-692d3abf8d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a70f6b6-16cb-4314-869d-692d3abf8d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-295428513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ab4907e-345c-4bed-95c1-d5196b41de81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb234c4b05648f6945f0914e9e29e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:14:53Z,use_quota=True,user_id='260b36739ad2454eb43af2df70174f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2088f44d-8d0a-4efa-8ecd-a361166ef2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2088f44d-8d0a-4efa-8ecd-a361166ef2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (513592e4-a750-498d-82dd-8681ca5033b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (513592e4-a750-498d-82dd-8681ca5033b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ab4907e-345c-4bed-95c1-d5196b41de81', 'volume_name': 'volume-7ab4907e-345c-4bed-95c1-d5196b41de81', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5033ccca-7fe8-4760-9564-9e8c041ba608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5033ccca-7fe8-4760-9564-9e8c041ba608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed44e693-4557-485c-bd9e-2cd8e6a59afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:14:52 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Volume 7ab4907e-345c-4bed-95c1-d5196b41de81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ab4907e-345c-4bed-95c1-d5196b41de81', 'volume_size': 1} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-295428513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ab4907e-345c-4bed-95c1-d5196b41de81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb234c4b05648f6945f0914e9e29e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:14:53Z,use_quota=True,user_id='260b36739ad2454eb43af2df70174f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Creating volume 7ab4907e-345c-4bed-95c1-d5196b41de81 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:14:52 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:14:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7ab4907e-345c-4bed-95c1-d5196b41de81 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:53 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7ab4907e-345c-4bed-95c1-d5196b41de81 1073741824 Sep 06 08:14:53 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:53 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7ab4907e-345c-4bed-95c1-d5196b41de81 1073741824" returned: 0 in 0.536s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7ab4907e-345c-4bed-95c1-d5196b41de81 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:53 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7ab4907e-345c-4bed-95c1-d5196b41de81 Sep 06 08:14:53 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:53 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7ab4907e-345c-4bed-95c1-d5196b41de81" returned: 0 in 0.313s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:14:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:14:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed44e693-4557-485c-bd9e-2cd8e6a59afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ab4907e-345c-4bed-95c1-d5196b41de81', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:14:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a20b72-36ab-42d0-9246-778ba601b28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:14:53 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Volume volume-7ab4907e-345c-4bed-95c1-d5196b41de81 (7ab4907e-345c-4bed-95c1-d5196b41de81): created successfully Sep 06 08:14:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a20b72-36ab-42d0-9246-778ba601b28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:14:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Flow 'volume_create_manager' (05579091-85ff-4960-b6c8-37da29a22459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:14:53 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-43ad1977-3b81-439b-88d7-83d4fcdcf309 tempest-VolumesActionsTest-1702047703 None] Created volume successfully. Sep 06 08:14:55 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e21f2fc9-3224-4122-b553-e4ccd16f343e tempest-VolumesActionsTest-779208237 None] Acquiring lock "cinder-7ab4907e-345c-4bed-95c1-d5196b41de81-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:14:55 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e21f2fc9-3224-4122-b553-e4ccd16f343e tempest-VolumesActionsTest-779208237 None] Lock "cinder-7ab4907e-345c-4bed-95c1-d5196b41de81-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:14:55 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e21f2fc9-3224-4122-b553-e4ccd16f343e tempest-VolumesActionsTest-779208237 None] Acquiring lock "cinder-quobyte-7ab4907e-345c-4bed-95c1-d5196b41de81" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:14:55 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e21f2fc9-3224-4122-b553-e4ccd16f343e tempest-VolumesActionsTest-779208237 None] Lock "cinder-quobyte-7ab4907e-345c-4bed-95c1-d5196b41de81" acquired by "delete_volume" :: waited 0.032s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:14:55 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8167e5-c741-4745-bd0e-832c63236a6d]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:14:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e21f2fc9-3224-4122-b553-e4ccd16f343e tempest-VolumesActionsTest-779208237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7ab4907e-345c-4bed-95c1-d5196b41de81 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:55 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7ab4907e-345c-4bed-95c1-d5196b41de81 Sep 06 08:14:55 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:55 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e21f2fc9-3224-4122-b553-e4ccd16f343e tempest-VolumesActionsTest-779208237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7ab4907e-345c-4bed-95c1-d5196b41de81" returned: 0 in 0.491s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e21f2fc9-3224-4122-b553-e4ccd16f343e tempest-VolumesActionsTest-779208237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7ab4907e-345c-4bed-95c1-d5196b41de81 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:55 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7ab4907e-345c-4bed-95c1-d5196b41de81 Sep 06 08:14:55 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:55 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e21f2fc9-3224-4122-b553-e4ccd16f343e tempest-VolumesActionsTest-779208237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7ab4907e-345c-4bed-95c1-d5196b41de81" returned: 0 in 0.279s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:55 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e21f2fc9-3224-4122-b553-e4ccd16f343e tempest-VolumesActionsTest-779208237 None] Lock "cinder-quobyte-7ab4907e-345c-4bed-95c1-d5196b41de81" released by "delete_volume" :: held 0.835s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:14:56 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-e21f2fc9-3224-4122-b553-e4ccd16f343e tempest-VolumesActionsTest-779208237 None] Created reservations ['24b974ac-4704-4d39-a9fc-15fd1593153b', 'e92926c2-9ec6-469f-868b-ad51636ab72d', '8bf5cc37-3af2-44b2-9b3e-38d52ff50130', '2a96535c-9773-4720-a425-8b8f51395ef1'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:14:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e21f2fc9-3224-4122-b553-e4ccd16f343e tempest-VolumesActionsTest-779208237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:14:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e21f2fc9-3224-4122-b553-e4ccd16f343e tempest-VolumesActionsTest-779208237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:14:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e21f2fc9-3224-4122-b553-e4ccd16f343e tempest-VolumesActionsTest-779208237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:14:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e21f2fc9-3224-4122-b553-e4ccd16f343e tempest-VolumesActionsTest-779208237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:14:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e21f2fc9-3224-4122-b553-e4ccd16f343e tempest-VolumesActionsTest-779208237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:14:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e21f2fc9-3224-4122-b553-e4ccd16f343e tempest-VolumesActionsTest-779208237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:56 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:14:56 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:56 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e21f2fc9-3224-4122-b553-e4ccd16f343e tempest-VolumesActionsTest-779208237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.377s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:56 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-e21f2fc9-3224-4122-b553-e4ccd16f343e tempest-VolumesActionsTest-779208237 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:14:56 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e21f2fc9-3224-4122-b553-e4ccd16f343e tempest-VolumesActionsTest-779208237 None] Deleted volume successfully. Sep 06 08:14:56 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-428d2c72-baa9-4c67-8447-18c8bb00604e req-4ccb3fed-7a0a-4234-ade9-d7dcef6c958b tempest-TestInstancesWithCinderVolumes-127884493 None] Terminate volume connection completed successfully. Sep 06 08:14:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-428d2c72-baa9-4c67-8447-18c8bb00604e req-4ccb3fed-7a0a-4234-ade9-d7dcef6c958b tempest-TestInstancesWithCinderVolumes-127884493 None] Deleting attachment a3b3dede-b8ea-4806-a5af-b3db8ce37457. {{(pid=87307) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 08:14:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e21f2fc9-3224-4122-b553-e4ccd16f343e tempest-VolumesActionsTest-779208237 None] Lock "cinder-7ab4907e-345c-4bed-95c1-d5196b41de81-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Flow 'volume_create_manager' (76b71118-0160-439a-8fb6-b02f4eaa9d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e39ea0-e94b-4f8b-8da8-d53c52bd2d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e39ea0-e94b-4f8b-8da8-d53c52bd2d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1909941242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeabbd3d-aa13-4050-87d5-11c02fdbd036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb234c4b05648f6945f0914e9e29e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:14:57Z,use_quota=True,user_id='260b36739ad2454eb43af2df70174f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab0882f-6959-4f9f-9edf-805902c7a613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab0882f-6959-4f9f-9edf-805902c7a613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a00ae9-22e4-41ad-ab0e-ada8e168039f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a00ae9-22e4-41ad-ab0e-ada8e168039f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeabbd3d-aa13-4050-87d5-11c02fdbd036', 'volume_name': 'volume-aeabbd3d-aa13-4050-87d5-11c02fdbd036', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed5f3e7-657f-4411-98d2-be5276241001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed5f3e7-657f-4411-98d2-be5276241001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (456e2c31-85ae-49c6-abd7-2a8f4071ad08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:14:57 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Volume aeabbd3d-aa13-4050-87d5-11c02fdbd036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeabbd3d-aa13-4050-87d5-11c02fdbd036', 'volume_size': 1} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1909941242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeabbd3d-aa13-4050-87d5-11c02fdbd036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb234c4b05648f6945f0914e9e29e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:14:57Z,use_quota=True,user_id='260b36739ad2454eb43af2df70174f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Creating volume aeabbd3d-aa13-4050-87d5-11c02fdbd036 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:14:57 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aeabbd3d-aa13-4050-87d5-11c02fdbd036 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:57 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aeabbd3d-aa13-4050-87d5-11c02fdbd036 1073741824 Sep 06 08:14:57 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-eb32cb61-ea99-4768-820a-226b20fadc32 tempest-TestInstancesWithCinderVolumes-127884493 None] Acquiring lock "cinder-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-eb32cb61-ea99-4768-820a-226b20fadc32 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "cinder-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:14:57 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-eb32cb61-ea99-4768-820a-226b20fadc32 tempest-TestInstancesWithCinderVolumes-127884493 None] Acquiring lock "cinder-quobyte-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aeabbd3d-aa13-4050-87d5-11c02fdbd036 1073741824" returned: 0 in 0.537s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-eb32cb61-ea99-4768-820a-226b20fadc32 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "cinder-quobyte-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3" acquired by "delete_volume" :: waited 0.024s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c6b4d7-4be2-4f58-8628-c414267d190f]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eb32cb61-ea99-4768-820a-226b20fadc32 tempest-TestInstancesWithCinderVolumes-127884493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aeabbd3d-aa13-4050-87d5-11c02fdbd036 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:57 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aeabbd3d-aa13-4050-87d5-11c02fdbd036 Sep 06 08:14:57 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:57 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3 Sep 06 08:14:57 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:58 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aeabbd3d-aa13-4050-87d5-11c02fdbd036" returned: 0 in 0.262s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:58 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:14:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:14:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (456e2c31-85ae-49c6-abd7-2a8f4071ad08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeabbd3d-aa13-4050-87d5-11c02fdbd036', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:14:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00274759-f1bd-4d6e-8077-385b977e40c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:14:58 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Volume volume-aeabbd3d-aa13-4050-87d5-11c02fdbd036 (aeabbd3d-aa13-4050-87d5-11c02fdbd036): created successfully Sep 06 08:14:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00274759-f1bd-4d6e-8077-385b977e40c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:14:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Flow 'volume_create_manager' (76b71118-0160-439a-8fb6-b02f4eaa9d24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:14:58 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-922dbae3-0c41-4012-8627-ee4f5866c7c8 tempest-VolumesActionsTest-1702047703 None] Created volume successfully. Sep 06 08:14:58 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eb32cb61-ea99-4768-820a-226b20fadc32 tempest-TestInstancesWithCinderVolumes-127884493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3" returned: 0 in 0.427s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eb32cb61-ea99-4768-820a-226b20fadc32 tempest-TestInstancesWithCinderVolumes-127884493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:58 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3 Sep 06 08:14:58 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:58 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eb32cb61-ea99-4768-820a-226b20fadc32 tempest-TestInstancesWithCinderVolumes-127884493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3" returned: 0 in 0.306s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-eb32cb61-ea99-4768-820a-226b20fadc32 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "cinder-quobyte-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3" released by "delete_volume" :: held 0.788s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:14:58 devstack cinder-volume[87307]: WARNING cinder.quota [None req-eb32cb61-ea99-4768-820a-226b20fadc32 tempest-TestInstancesWithCinderVolumes-127884493 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1774689506-475998114 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1774689506-475998114, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:14:58 devstack cinder-volume[87307]: WARNING cinder.quota [None req-eb32cb61-ea99-4768-820a-226b20fadc32 tempest-TestInstancesWithCinderVolumes-127884493 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1774689506-475998114 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1774689506-475998114, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:14:58 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-eb32cb61-ea99-4768-820a-226b20fadc32 tempest-TestInstancesWithCinderVolumes-127884493 None] Created reservations ['834e1593-0625-47b3-a7aa-64fc6689ebb7', '7a2e186d-745b-47e2-b7d2-a99eb84de4ae', 'c2449eac-78da-42e9-a9a7-c68db115723d', 'cefc1fe9-3504-4747-88c4-c6931583748f'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:14:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-eb32cb61-ea99-4768-820a-226b20fadc32 tempest-TestInstancesWithCinderVolumes-127884493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:14:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-eb32cb61-ea99-4768-820a-226b20fadc32 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:14:58 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-eb32cb61-ea99-4768-820a-226b20fadc32 tempest-TestInstancesWithCinderVolumes-127884493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:14:58 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-eb32cb61-ea99-4768-820a-226b20fadc32 tempest-TestInstancesWithCinderVolumes-127884493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:14:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-eb32cb61-ea99-4768-820a-226b20fadc32 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:14:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eb32cb61-ea99-4768-820a-226b20fadc32 tempest-TestInstancesWithCinderVolumes-127884493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:58 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:14:58 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:59 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eb32cb61-ea99-4768-820a-226b20fadc32 tempest-TestInstancesWithCinderVolumes-127884493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.409s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:59 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-eb32cb61-ea99-4768-820a-226b20fadc32 tempest-TestInstancesWithCinderVolumes-127884493 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:14:59 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-eb32cb61-ea99-4768-820a-226b20fadc32 tempest-TestInstancesWithCinderVolumes-127884493 None] Deleted volume successfully. Sep 06 08:14:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-eb32cb61-ea99-4768-820a-226b20fadc32 tempest-TestInstancesWithCinderVolumes-127884493 None] Lock "cinder-aa8f58aa-f80c-4800-8e53-2fcc5190e1f3-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:14:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-52584097-f52e-403f-b2ae-2eea3a963698 tempest-VolumesActionsTest-779208237 None] Acquiring lock "cinder-aeabbd3d-aa13-4050-87d5-11c02fdbd036-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:14:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-52584097-f52e-403f-b2ae-2eea3a963698 tempest-VolumesActionsTest-779208237 None] Lock "cinder-aeabbd3d-aa13-4050-87d5-11c02fdbd036-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:14:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-52584097-f52e-403f-b2ae-2eea3a963698 tempest-VolumesActionsTest-779208237 None] Acquiring lock "cinder-quobyte-aeabbd3d-aa13-4050-87d5-11c02fdbd036" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:14:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-52584097-f52e-403f-b2ae-2eea3a963698 tempest-VolumesActionsTest-779208237 None] Lock "cinder-quobyte-aeabbd3d-aa13-4050-87d5-11c02fdbd036" acquired by "delete_volume" :: waited 0.027s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:14:59 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f8c4ff-9da3-4747-968a-66ee6297e002]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:14:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-52584097-f52e-403f-b2ae-2eea3a963698 tempest-VolumesActionsTest-779208237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aeabbd3d-aa13-4050-87d5-11c02fdbd036 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:59 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aeabbd3d-aa13-4050-87d5-11c02fdbd036 Sep 06 08:14:59 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:14:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:14:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:14:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:14:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:14:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:14:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:59 devstack sudo[100864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:14:59 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:14:59 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-52584097-f52e-403f-b2ae-2eea3a963698 tempest-VolumesActionsTest-779208237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aeabbd3d-aa13-4050-87d5-11c02fdbd036" returned: 0 in 0.531s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-52584097-f52e-403f-b2ae-2eea3a963698 tempest-VolumesActionsTest-779208237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aeabbd3d-aa13-4050-87d5-11c02fdbd036 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:14:59 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root Sep 06 08:14:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.304s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:14:59 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:14:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager._thread_info {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:14:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread count: 28 {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 08:14:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread info: [<_MainThread(MainThread, started 139985167040640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:15:00 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aeabbd3d-aa13-4050-87d5-11c02fdbd036 Sep 06 08:15:00 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:00 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-52584097-f52e-403f-b2ae-2eea3a963698 tempest-VolumesActionsTest-779208237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-aeabbd3d-aa13-4050-87d5-11c02fdbd036" returned: 0 in 0.281s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-52584097-f52e-403f-b2ae-2eea3a963698 tempest-VolumesActionsTest-779208237 None] Lock "cinder-quobyte-aeabbd3d-aa13-4050-87d5-11c02fdbd036" released by "delete_volume" :: held 0.864s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:00 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-52584097-f52e-403f-b2ae-2eea3a963698 tempest-VolumesActionsTest-779208237 None] Created reservations ['b2b819b7-21a4-4310-8c26-b73f4064e26c', 'dab2d76d-0dc3-4450-b16e-86a22af63447', '1d66526b-8100-4ccc-a86a-d7bbeb44e2ec', '850690dc-5d6c-418e-8892-ac28a9a3472a'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:15:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-52584097-f52e-403f-b2ae-2eea3a963698 tempest-VolumesActionsTest-779208237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-52584097-f52e-403f-b2ae-2eea3a963698 tempest-VolumesActionsTest-779208237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-52584097-f52e-403f-b2ae-2eea3a963698 tempest-VolumesActionsTest-779208237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-52584097-f52e-403f-b2ae-2eea3a963698 tempest-VolumesActionsTest-779208237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-52584097-f52e-403f-b2ae-2eea3a963698 tempest-VolumesActionsTest-779208237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-52584097-f52e-403f-b2ae-2eea3a963698 tempest-VolumesActionsTest-779208237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:00 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:15:00 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:00 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-52584097-f52e-403f-b2ae-2eea3a963698 tempest-VolumesActionsTest-779208237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.346s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:00 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-52584097-f52e-403f-b2ae-2eea3a963698 tempest-VolumesActionsTest-779208237 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:15:00 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-52584097-f52e-403f-b2ae-2eea3a963698 tempest-VolumesActionsTest-779208237 None] Deleted volume successfully. Sep 06 08:15:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-52584097-f52e-403f-b2ae-2eea3a963698 tempest-VolumesActionsTest-779208237 None] Lock "cinder-aeabbd3d-aa13-4050-87d5-11c02fdbd036-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:01 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:15:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Flow 'volume_create_manager' (10e6c156-e6b9-455a-9c3c-cba599ed3a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9ced238-f259-4385-81dc-1a0f57deee17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9ced238-f259-4385-81dc-1a0f57deee17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1041226855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d2645a-ec84-4e3b-9121-862755186bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb234c4b05648f6945f0914e9e29e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:01Z,use_quota=True,user_id='260b36739ad2454eb43af2df70174f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b66073-2ad6-4326-96d1-c450bb471965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b66073-2ad6-4326-96d1-c450bb471965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3084a91d-f31d-4ec6-b814-8791152a0a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3084a91d-f31d-4ec6-b814-8791152a0a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6d2645a-ec84-4e3b-9121-862755186bfe', 'volume_name': 'volume-c6d2645a-ec84-4e3b-9121-862755186bfe', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c80c2f5-07c8-47d3-89b7-30478e484ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c80c2f5-07c8-47d3-89b7-30478e484ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e5d74e-c076-4d65-96e6-c0b5a857575f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:01 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Volume c6d2645a-ec84-4e3b-9121-862755186bfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6d2645a-ec84-4e3b-9121-862755186bfe', 'volume_size': 1} Sep 06 08:15:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:01 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1041226855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d2645a-ec84-4e3b-9121-862755186bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb234c4b05648f6945f0914e9e29e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:01Z,use_quota=True,user_id='260b36739ad2454eb43af2df70174f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:15:01 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Creating volume c6d2645a-ec84-4e3b-9121-862755186bfe {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:15:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:01 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:01 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:01 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:15:01 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:15:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c6d2645a-ec84-4e3b-9121-862755186bfe 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:01 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c6d2645a-ec84-4e3b-9121-862755186bfe 1073741824 Sep 06 08:15:01 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:02 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c6d2645a-ec84-4e3b-9121-862755186bfe 1073741824" returned: 0 in 0.666s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c6d2645a-ec84-4e3b-9121-862755186bfe {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:02 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c6d2645a-ec84-4e3b-9121-862755186bfe Sep 06 08:15:02 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:02 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c6d2645a-ec84-4e3b-9121-862755186bfe" returned: 0 in 0.285s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:02 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:15:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:02 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e5d74e-c076-4d65-96e6-c0b5a857575f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6d2645a-ec84-4e3b-9121-862755186bfe', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:02 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4e1221-1e7a-4d79-9d21-ff4dd17bd26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:02 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Volume volume-c6d2645a-ec84-4e3b-9121-862755186bfe (c6d2645a-ec84-4e3b-9121-862755186bfe): created successfully Sep 06 08:15:02 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4e1221-1e7a-4d79-9d21-ff4dd17bd26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:02 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Flow 'volume_create_manager' (10e6c156-e6b9-455a-9c3c-cba599ed3a92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:02 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-88e2a98d-63a8-46f9-ab27-c655bcf1ebea tempest-VolumesActionsTest-1702047703 None] Created volume successfully. Sep 06 08:15:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a7967a0e-373f-4789-a22e-328f364e8e51 tempest-VolumesActionsTest-779208237 None] Acquiring lock "cinder-c6d2645a-ec84-4e3b-9121-862755186bfe-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a7967a0e-373f-4789-a22e-328f364e8e51 tempest-VolumesActionsTest-779208237 None] Lock "cinder-c6d2645a-ec84-4e3b-9121-862755186bfe-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a7967a0e-373f-4789-a22e-328f364e8e51 tempest-VolumesActionsTest-779208237 None] Acquiring lock "cinder-quobyte-c6d2645a-ec84-4e3b-9121-862755186bfe" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a7967a0e-373f-4789-a22e-328f364e8e51 tempest-VolumesActionsTest-779208237 None] Lock "cinder-quobyte-c6d2645a-ec84-4e3b-9121-862755186bfe" acquired by "delete_volume" :: waited 0.019s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:03 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41161db-2800-4764-9e87-7b6f492f9aff]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:15:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a7967a0e-373f-4789-a22e-328f364e8e51 tempest-VolumesActionsTest-779208237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c6d2645a-ec84-4e3b-9121-862755186bfe {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:03 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c6d2645a-ec84-4e3b-9121-862755186bfe Sep 06 08:15:03 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:04 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a7967a0e-373f-4789-a22e-328f364e8e51 tempest-VolumesActionsTest-779208237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c6d2645a-ec84-4e3b-9121-862755186bfe" returned: 0 in 0.527s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a7967a0e-373f-4789-a22e-328f364e8e51 tempest-VolumesActionsTest-779208237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c6d2645a-ec84-4e3b-9121-862755186bfe {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:04 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c6d2645a-ec84-4e3b-9121-862755186bfe Sep 06 08:15:04 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:04 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a7967a0e-373f-4789-a22e-328f364e8e51 tempest-VolumesActionsTest-779208237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c6d2645a-ec84-4e3b-9121-862755186bfe" returned: 0 in 0.279s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:04 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a7967a0e-373f-4789-a22e-328f364e8e51 tempest-VolumesActionsTest-779208237 None] Lock "cinder-quobyte-c6d2645a-ec84-4e3b-9121-862755186bfe" released by "delete_volume" :: held 0.863s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:04 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-a7967a0e-373f-4789-a22e-328f364e8e51 tempest-VolumesActionsTest-779208237 None] Created reservations ['289d0675-5e14-4daf-bb03-db15b7660905', '129b6a00-fb81-43a1-a9c2-514cad8c3e39', '95576d30-3f8d-4ab4-b4af-eb799b7970cb', '6e46244b-4092-442b-8eab-51d5226e4904'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:15:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a7967a0e-373f-4789-a22e-328f364e8e51 tempest-VolumesActionsTest-779208237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a7967a0e-373f-4789-a22e-328f364e8e51 tempest-VolumesActionsTest-779208237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:04 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a7967a0e-373f-4789-a22e-328f364e8e51 tempest-VolumesActionsTest-779208237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:04 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a7967a0e-373f-4789-a22e-328f364e8e51 tempest-VolumesActionsTest-779208237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a7967a0e-373f-4789-a22e-328f364e8e51 tempest-VolumesActionsTest-779208237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a7967a0e-373f-4789-a22e-328f364e8e51 tempest-VolumesActionsTest-779208237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:04 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:15:04 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:05 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a7967a0e-373f-4789-a22e-328f364e8e51 tempest-VolumesActionsTest-779208237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.377s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-a7967a0e-373f-4789-a22e-328f364e8e51 tempest-VolumesActionsTest-779208237 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:15:05 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-a7967a0e-373f-4789-a22e-328f364e8e51 tempest-VolumesActionsTest-779208237 None] Deleted volume successfully. Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a7967a0e-373f-4789-a22e-328f364e8e51 tempest-VolumesActionsTest-779208237 None] Lock "cinder-c6d2645a-ec84-4e3b-9121-862755186bfe-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Flow 'volume_create_manager' (f204f84b-fa0c-4fdc-8429-1b16e1bdc29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191a223d-4bbc-4d01-a20e-60a4583fb025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191a223d-4bbc-4d01-a20e-60a4583fb025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1808242486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fe76551-1602-40cc-a2fa-17960936239f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb234c4b05648f6945f0914e9e29e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:05Z,use_quota=True,user_id='260b36739ad2454eb43af2df70174f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e005f86a-9088-492d-9358-64844c28cdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e005f86a-9088-492d-9358-64844c28cdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32cc813a-a50a-42a9-9994-41372b28018d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32cc813a-a50a-42a9-9994-41372b28018d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fe76551-1602-40cc-a2fa-17960936239f', 'volume_name': 'volume-6fe76551-1602-40cc-a2fa-17960936239f', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d32ec1-01ad-497d-940a-b40573eaaa93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d32ec1-01ad-497d-940a-b40573eaaa93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73c93a4-69e1-4ca6-8a36-0c47478629c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:05 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Volume 6fe76551-1602-40cc-a2fa-17960936239f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fe76551-1602-40cc-a2fa-17960936239f', 'volume_size': 1} Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1808242486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fe76551-1602-40cc-a2fa-17960936239f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb234c4b05648f6945f0914e9e29e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:05Z,use_quota=True,user_id='260b36739ad2454eb43af2df70174f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Creating volume 6fe76551-1602-40cc-a2fa-17960936239f {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:15:05 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:15:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6fe76551-1602-40cc-a2fa-17960936239f 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:05 devstack sudo[100910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6fe76551-1602-40cc-a2fa-17960936239f 1073741824 Sep 06 08:15:05 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:06 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6fe76551-1602-40cc-a2fa-17960936239f 1073741824" returned: 0 in 0.617s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6fe76551-1602-40cc-a2fa-17960936239f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:06 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6fe76551-1602-40cc-a2fa-17960936239f Sep 06 08:15:06 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:06 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6fe76551-1602-40cc-a2fa-17960936239f" returned: 0 in 0.319s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:15:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73c93a4-69e1-4ca6-8a36-0c47478629c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fe76551-1602-40cc-a2fa-17960936239f', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10cdd75a-6183-402b-a074-9ae4b979075a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:06 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Volume volume-6fe76551-1602-40cc-a2fa-17960936239f (6fe76551-1602-40cc-a2fa-17960936239f): created successfully Sep 06 08:15:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10cdd75a-6183-402b-a074-9ae4b979075a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Flow 'volume_create_manager' (f204f84b-fa0c-4fdc-8429-1b16e1bdc29d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:06 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-8624f19f-de94-4c06-983c-eebbc5f2fede tempest-VolumesActionsTest-1702047703 None] Created volume successfully. Sep 06 08:15:07 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b02f92c9-0fa8-405e-b71c-e04a004a7817 tempest-VolumesActionsTest-779208237 None] Acquiring lock "cinder-6fe76551-1602-40cc-a2fa-17960936239f-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:07 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b02f92c9-0fa8-405e-b71c-e04a004a7817 tempest-VolumesActionsTest-779208237 None] Lock "cinder-6fe76551-1602-40cc-a2fa-17960936239f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:07 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b02f92c9-0fa8-405e-b71c-e04a004a7817 tempest-VolumesActionsTest-779208237 None] Acquiring lock "cinder-quobyte-6fe76551-1602-40cc-a2fa-17960936239f" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:07 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b02f92c9-0fa8-405e-b71c-e04a004a7817 tempest-VolumesActionsTest-779208237 None] Lock "cinder-quobyte-6fe76551-1602-40cc-a2fa-17960936239f" acquired by "delete_volume" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:07 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b9932f-9864-4cd1-92e1-a7fed2d5b780]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:15:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b02f92c9-0fa8-405e-b71c-e04a004a7817 tempest-VolumesActionsTest-779208237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6fe76551-1602-40cc-a2fa-17960936239f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:08 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6fe76551-1602-40cc-a2fa-17960936239f Sep 06 08:15:08 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:08 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b02f92c9-0fa8-405e-b71c-e04a004a7817 tempest-VolumesActionsTest-779208237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6fe76551-1602-40cc-a2fa-17960936239f" returned: 0 in 0.415s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b02f92c9-0fa8-405e-b71c-e04a004a7817 tempest-VolumesActionsTest-779208237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6fe76551-1602-40cc-a2fa-17960936239f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:08 devstack sudo[100926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6fe76551-1602-40cc-a2fa-17960936239f Sep 06 08:15:08 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:08 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b02f92c9-0fa8-405e-b71c-e04a004a7817 tempest-VolumesActionsTest-779208237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6fe76551-1602-40cc-a2fa-17960936239f" returned: 0 in 0.263s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:08 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b02f92c9-0fa8-405e-b71c-e04a004a7817 tempest-VolumesActionsTest-779208237 None] Lock "cinder-quobyte-6fe76551-1602-40cc-a2fa-17960936239f" released by "delete_volume" :: held 0.723s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:08 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-b02f92c9-0fa8-405e-b71c-e04a004a7817 tempest-VolumesActionsTest-779208237 None] Created reservations ['86a3d938-4633-4f95-ba0a-69ae93aa2518', '9234fad7-d69e-4786-a099-78cad67ca7e4', '0d2342d5-af39-4b41-b50d-9a3a6e14ca80', 'be41007e-fc80-409f-8200-1e1b1285ef59'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:15:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b02f92c9-0fa8-405e-b71c-e04a004a7817 tempest-VolumesActionsTest-779208237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b02f92c9-0fa8-405e-b71c-e04a004a7817 tempest-VolumesActionsTest-779208237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:08 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b02f92c9-0fa8-405e-b71c-e04a004a7817 tempest-VolumesActionsTest-779208237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:08 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b02f92c9-0fa8-405e-b71c-e04a004a7817 tempest-VolumesActionsTest-779208237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b02f92c9-0fa8-405e-b71c-e04a004a7817 tempest-VolumesActionsTest-779208237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b02f92c9-0fa8-405e-b71c-e04a004a7817 tempest-VolumesActionsTest-779208237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:08 devstack sudo[100929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:15:08 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:09 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b02f92c9-0fa8-405e-b71c-e04a004a7817 tempest-VolumesActionsTest-779208237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.351s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-b02f92c9-0fa8-405e-b71c-e04a004a7817 tempest-VolumesActionsTest-779208237 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:15:09 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-b02f92c9-0fa8-405e-b71c-e04a004a7817 tempest-VolumesActionsTest-779208237 None] Deleted volume successfully. Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b02f92c9-0fa8-405e-b71c-e04a004a7817 tempest-VolumesActionsTest-779208237 None] Lock "cinder-6fe76551-1602-40cc-a2fa-17960936239f-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Flow 'volume_create_manager' (6ff242a9-5a9a-49e9-9462-6fe55a72baa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f6d127-5cdd-4788-9647-d40beec0d608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f6d127-5cdd-4788-9647-d40beec0d608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1091705572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75cfc1c3-f365-492f-9b84-9577aa6a43d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb234c4b05648f6945f0914e9e29e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:10Z,use_quota=True,user_id='260b36739ad2454eb43af2df70174f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c4c120-4dd2-4d33-a60b-831dacff528a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c4c120-4dd2-4d33-a60b-831dacff528a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781e7199-7821-4c44-a35f-8d94b858cd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781e7199-7821-4c44-a35f-8d94b858cd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75cfc1c3-f365-492f-9b84-9577aa6a43d4', 'volume_name': 'volume-75cfc1c3-f365-492f-9b84-9577aa6a43d4', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c69f4c94-d48d-4dbb-b4ee-2551187bf004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c69f4c94-d48d-4dbb-b4ee-2551187bf004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6db9f2-81c4-4fda-ad8b-0d86d7b0767b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:09 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Volume 75cfc1c3-f365-492f-9b84-9577aa6a43d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75cfc1c3-f365-492f-9b84-9577aa6a43d4', 'volume_size': 1} Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1091705572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75cfc1c3-f365-492f-9b84-9577aa6a43d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb234c4b05648f6945f0914e9e29e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:10Z,use_quota=True,user_id='260b36739ad2454eb43af2df70174f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Creating volume 75cfc1c3-f365-492f-9b84-9577aa6a43d4 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:15:09 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:15:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-75cfc1c3-f365-492f-9b84-9577aa6a43d4 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:09 devstack sudo[100935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-75cfc1c3-f365-492f-9b84-9577aa6a43d4 1073741824 Sep 06 08:15:09 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:10 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-75cfc1c3-f365-492f-9b84-9577aa6a43d4 1073741824" returned: 0 in 0.590s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-75cfc1c3-f365-492f-9b84-9577aa6a43d4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:10 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-75cfc1c3-f365-492f-9b84-9577aa6a43d4 Sep 06 08:15:10 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:10 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-75cfc1c3-f365-492f-9b84-9577aa6a43d4" returned: 0 in 0.318s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:15:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6db9f2-81c4-4fda-ad8b-0d86d7b0767b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75cfc1c3-f365-492f-9b84-9577aa6a43d4', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e567379-bd86-4d9c-ad29-6804ee5db89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:10 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Volume volume-75cfc1c3-f365-492f-9b84-9577aa6a43d4 (75cfc1c3-f365-492f-9b84-9577aa6a43d4): created successfully Sep 06 08:15:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e567379-bd86-4d9c-ad29-6804ee5db89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Flow 'volume_create_manager' (6ff242a9-5a9a-49e9-9462-6fe55a72baa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:10 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-a552d4f5-a168-4685-bc6d-f5eb217ab967 tempest-VolumesActionsTest-1702047703 None] Created volume successfully. Sep 06 08:15:12 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1cb3081c-6eb2-4005-b3be-73204d0227df tempest-VolumesActionsTest-1702047703 None] Acquiring lock "cinder-75cfc1c3-f365-492f-9b84-9577aa6a43d4-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:12 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1cb3081c-6eb2-4005-b3be-73204d0227df tempest-VolumesActionsTest-1702047703 None] Lock "cinder-75cfc1c3-f365-492f-9b84-9577aa6a43d4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:12 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1cb3081c-6eb2-4005-b3be-73204d0227df tempest-VolumesActionsTest-1702047703 None] Acquiring lock "cinder-quobyte-75cfc1c3-f365-492f-9b84-9577aa6a43d4" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:12 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1cb3081c-6eb2-4005-b3be-73204d0227df tempest-VolumesActionsTest-1702047703 None] Lock "cinder-quobyte-75cfc1c3-f365-492f-9b84-9577aa6a43d4" acquired by "delete_volume" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:12 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4729f8-6f18-48d0-905a-110184e6489d]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:15:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1cb3081c-6eb2-4005-b3be-73204d0227df tempest-VolumesActionsTest-1702047703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-75cfc1c3-f365-492f-9b84-9577aa6a43d4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:12 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-75cfc1c3-f365-492f-9b84-9577aa6a43d4 Sep 06 08:15:12 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:13 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1cb3081c-6eb2-4005-b3be-73204d0227df tempest-VolumesActionsTest-1702047703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-75cfc1c3-f365-492f-9b84-9577aa6a43d4" returned: 0 in 0.433s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1cb3081c-6eb2-4005-b3be-73204d0227df tempest-VolumesActionsTest-1702047703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-75cfc1c3-f365-492f-9b84-9577aa6a43d4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:13 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-75cfc1c3-f365-492f-9b84-9577aa6a43d4 Sep 06 08:15:13 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:13 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1cb3081c-6eb2-4005-b3be-73204d0227df tempest-VolumesActionsTest-1702047703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-75cfc1c3-f365-492f-9b84-9577aa6a43d4" returned: 0 in 0.308s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1cb3081c-6eb2-4005-b3be-73204d0227df tempest-VolumesActionsTest-1702047703 None] Lock "cinder-quobyte-75cfc1c3-f365-492f-9b84-9577aa6a43d4" released by "delete_volume" :: held 0.794s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:13 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-1cb3081c-6eb2-4005-b3be-73204d0227df tempest-VolumesActionsTest-1702047703 None] Created reservations ['904af394-d04f-4b5a-bccf-1fcff79dae44', 'dea19cfc-cbef-45ab-89ca-d4c8f16610fc', '791100c9-92a9-4714-a1b8-11bab4c035fa', '06023b28-3133-4b66-8a11-a60f0c821f61'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:15:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1cb3081c-6eb2-4005-b3be-73204d0227df tempest-VolumesActionsTest-1702047703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1cb3081c-6eb2-4005-b3be-73204d0227df tempest-VolumesActionsTest-1702047703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1cb3081c-6eb2-4005-b3be-73204d0227df tempest-VolumesActionsTest-1702047703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1cb3081c-6eb2-4005-b3be-73204d0227df tempest-VolumesActionsTest-1702047703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1cb3081c-6eb2-4005-b3be-73204d0227df tempest-VolumesActionsTest-1702047703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1cb3081c-6eb2-4005-b3be-73204d0227df tempest-VolumesActionsTest-1702047703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:13 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:15:13 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:13 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1cb3081c-6eb2-4005-b3be-73204d0227df tempest-VolumesActionsTest-1702047703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.404s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:13 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-1cb3081c-6eb2-4005-b3be-73204d0227df tempest-VolumesActionsTest-1702047703 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:15:14 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-1cb3081c-6eb2-4005-b3be-73204d0227df tempest-VolumesActionsTest-1702047703 None] Deleted volume successfully. Sep 06 08:15:14 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1cb3081c-6eb2-4005-b3be-73204d0227df tempest-VolumesActionsTest-1702047703 None] Lock "cinder-75cfc1c3-f365-492f-9b84-9577aa6a43d4-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:14 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:15:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Flow 'volume_create_manager' (9ec3b9be-b9db-4ba7-bc90-94adc8c9f871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96be1352-a076-42e4-8748-a310566cc1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96be1352-a076-42e4-8748-a310566cc1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-584492353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e8b434-a71c-4cce-9990-cb2cc6c3569e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f61c73705c4eaabbedf3b434588302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:15Z,use_quota=True,user_id='777d7c51704f4563a99335bdb46d6460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764d7da0-ef98-48f8-a88e-1dd99d5a5aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764d7da0-ef98-48f8-a88e-1dd99d5a5aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93cbe632-8c16-4f5c-9c5f-8fecfc016cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93cbe632-8c16-4f5c-9c5f-8fecfc016cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35e8b434-a71c-4cce-9990-cb2cc6c3569e', 'volume_name': 'volume-35e8b434-a71c-4cce-9990-cb2cc6c3569e', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf0123e2-f6f6-43a3-9fbb-d633e803c007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf0123e2-f6f6-43a3-9fbb-d633e803c007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f902298a-c19e-4019-b27f-c2c53095cbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:14 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Volume 35e8b434-a71c-4cce-9990-cb2cc6c3569e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35e8b434-a71c-4cce-9990-cb2cc6c3569e', 'volume_size': 1} Sep 06 08:15:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-584492353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e8b434-a71c-4cce-9990-cb2cc6c3569e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f61c73705c4eaabbedf3b434588302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:15Z,use_quota=True,user_id='777d7c51704f4563a99335bdb46d6460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:15:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Creating volume 35e8b434-a71c-4cce-9990-cb2cc6c3569e {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:15:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:15:14 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:15:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-35e8b434-a71c-4cce-9990-cb2cc6c3569e 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:14 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-35e8b434-a71c-4cce-9990-cb2cc6c3569e 1073741824 Sep 06 08:15:14 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:15 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-35e8b434-a71c-4cce-9990-cb2cc6c3569e 1073741824" returned: 0 in 0.864s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-35e8b434-a71c-4cce-9990-cb2cc6c3569e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:15 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-35e8b434-a71c-4cce-9990-cb2cc6c3569e Sep 06 08:15:15 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:16 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-35e8b434-a71c-4cce-9990-cb2cc6c3569e" returned: 0 in 0.338s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:16 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:15:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f902298a-c19e-4019-b27f-c2c53095cbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35e8b434-a71c-4cce-9990-cb2cc6c3569e', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c86a246-f067-46ba-99fe-3dc19b9bc0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:16 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Volume volume-35e8b434-a71c-4cce-9990-cb2cc6c3569e (35e8b434-a71c-4cce-9990-cb2cc6c3569e): created successfully Sep 06 08:15:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c86a246-f067-46ba-99fe-3dc19b9bc0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Flow 'volume_create_manager' (9ec3b9be-b9db-4ba7-bc90-94adc8c9f871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:16 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-1a0d296d-414b-4492-b9e9-77b3e41a3f07 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Created volume successfully. Sep 06 08:15:17 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:15:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Flow 'volume_create_manager' (ac388ad4-3c9f-4f6b-bfbc-8eb5051f3c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d6f5b4-7fc8-4a34-9e7a-88a3ae7aa038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d6f5b4-7fc8-4a34-9e7a-88a3ae7aa038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-613008597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9530923e-0ef6-4656-b7d8-4dd58382f219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f61c73705c4eaabbedf3b434588302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:18Z,use_quota=True,user_id='777d7c51704f4563a99335bdb46d6460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4edbd282-08a8-43e1-b147-e5580111f580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4edbd282-08a8-43e1-b147-e5580111f580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec89265-4aa4-4014-9021-8647540ea520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec89265-4aa4-4014-9021-8647540ea520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9530923e-0ef6-4656-b7d8-4dd58382f219', 'volume_name': 'volume-9530923e-0ef6-4656-b7d8-4dd58382f219', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8a2cb00-c763-45df-8772-bc6db6c3568a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8a2cb00-c763-45df-8772-bc6db6c3568a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf12f6d1-59a2-4bc7-854f-2285a9e53ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:17 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Volume 9530923e-0ef6-4656-b7d8-4dd58382f219: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9530923e-0ef6-4656-b7d8-4dd58382f219', 'volume_size': 1} Sep 06 08:15:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-613008597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9530923e-0ef6-4656-b7d8-4dd58382f219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f61c73705c4eaabbedf3b434588302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:18Z,use_quota=True,user_id='777d7c51704f4563a99335bdb46d6460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:15:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Creating volume 9530923e-0ef6-4656-b7d8-4dd58382f219 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:15:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:15:17 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:15:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9530923e-0ef6-4656-b7d8-4dd58382f219 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:18 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9530923e-0ef6-4656-b7d8-4dd58382f219 1073741824 Sep 06 08:15:18 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:18 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:15:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Flow 'volume_create_manager' (7ebcec96-6067-410b-a944-b3ec9d6bacf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d91fe6e9-6bf1-43ae-a5b2-3929abc4c5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d91fe6e9-6bf1-43ae-a5b2-3929abc4c5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-181811437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8992b84c-2333-48e9-b92e-47d15d740bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f61c73705c4eaabbedf3b434588302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:18Z,use_quota=True,user_id='777d7c51704f4563a99335bdb46d6460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2b26a0-7051-43bc-a5bf-fd6af9abe141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2b26a0-7051-43bc-a5bf-fd6af9abe141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e46736d-af83-4e5f-bab8-95249a27aadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e46736d-af83-4e5f-bab8-95249a27aadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8992b84c-2333-48e9-b92e-47d15d740bf0', 'volume_name': 'volume-8992b84c-2333-48e9-b92e-47d15d740bf0', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7386370-3394-4f2e-9f2b-058b1b43412c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7386370-3394-4f2e-9f2b-058b1b43412c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b731e828-3611-475a-881f-72199c3ca19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:18 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Volume 8992b84c-2333-48e9-b92e-47d15d740bf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8992b84c-2333-48e9-b92e-47d15d740bf0', 'volume_size': 1} Sep 06 08:15:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:18 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9530923e-0ef6-4656-b7d8-4dd58382f219 1073741824" returned: 0 in 0.887s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:18 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:15:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Flow 'volume_create_manager' (091dcb14-36b0-4b4e-91fe-17223c4b938d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd08f3f3-dba4-4bfd-9c1d-5ee6647e95af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9530923e-0ef6-4656-b7d8-4dd58382f219 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:18 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9530923e-0ef6-4656-b7d8-4dd58382f219 Sep 06 08:15:18 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd08f3f3-dba4-4bfd-9c1d-5ee6647e95af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1508687978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f46b8899-57d9-4e63-8226-2d077f7659c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f61c73705c4eaabbedf3b434588302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:19Z,use_quota=True,user_id='777d7c51704f4563a99335bdb46d6460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf11a73c-b865-4c26-b2c6-6bbdbf6829ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf11a73c-b865-4c26-b2c6-6bbdbf6829ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef52e90-4b7b-4f8a-bb58-df86e39696d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef52e90-4b7b-4f8a-bb58-df86e39696d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f46b8899-57d9-4e63-8226-2d077f7659c2', 'volume_name': 'volume-f46b8899-57d9-4e63-8226-2d077f7659c2', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498fbd2b-d9f2-46e9-b02d-070fac7d90dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498fbd2b-d9f2-46e9-b02d-070fac7d90dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ede6aa-7e92-45ea-9e08-c7347814f8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:19 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Volume f46b8899-57d9-4e63-8226-2d077f7659c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f46b8899-57d9-4e63-8226-2d077f7659c2', 'volume_size': 1} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:19 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9530923e-0ef6-4656-b7d8-4dd58382f219" returned: 0 in 0.627s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.983s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-181811437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8992b84c-2333-48e9-b92e-47d15d740bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f61c73705c4eaabbedf3b434588302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:18Z,use_quota=True,user_id='777d7c51704f4563a99335bdb46d6460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Creating volume 8992b84c-2333-48e9-b92e-47d15d740bf0 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:15:19 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8992b84c-2333-48e9-b92e-47d15d740bf0 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:19 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8992b84c-2333-48e9-b92e-47d15d740bf0 1073741824 Sep 06 08:15:19 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf12f6d1-59a2-4bc7-854f-2285a9e53ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9530923e-0ef6-4656-b7d8-4dd58382f219', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73459d50-51d4-439d-8d85-1383d1edbf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:19 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Volume volume-9530923e-0ef6-4656-b7d8-4dd58382f219 (9530923e-0ef6-4656-b7d8-4dd58382f219): created successfully Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73459d50-51d4-439d-8d85-1383d1edbf66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Flow 'volume_create_manager' (ac388ad4-3c9f-4f6b-bfbc-8eb5051f3c9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Flow 'volume_create_manager' (aebc93b1-46cf-426a-9b4f-b5d8aa14371e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77343cd6-2221-4912-ae9c-6c0287de2011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:19 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-883892e9-ff8e-4999-9c51-0ecd81d2872a tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Created volume successfully. Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77343cd6-2221-4912-ae9c-6c0287de2011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-565086412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d233beb-5f9f-4769-a475-8ef182290be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f61c73705c4eaabbedf3b434588302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:20Z,use_quota=True,user_id='777d7c51704f4563a99335bdb46d6460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd62cfca-6d8d-4810-a67e-0e3dbdc56ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd62cfca-6d8d-4810-a67e-0e3dbdc56ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fbb1a92-1ebe-40df-94e1-37f96802c685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fbb1a92-1ebe-40df-94e1-37f96802c685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d233beb-5f9f-4769-a475-8ef182290be9', 'volume_name': 'volume-0d233beb-5f9f-4769-a475-8ef182290be9', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b3a1c8-c6e7-40bf-9f40-b9880a8568ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b3a1c8-c6e7-40bf-9f40-b9880a8568ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07793ba9-4b8e-473a-b854-16cbc3b7f760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:19 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Volume 0d233beb-5f9f-4769-a475-8ef182290be9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d233beb-5f9f-4769-a475-8ef182290be9', 'volume_size': 1} Sep 06 08:15:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:15:20 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Flow 'volume_create_manager' (3aecaaac-dc67-4b4e-be5c-20a698af2084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5bdf349-10e0-49ce-a78f-e3766e83e00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8992b84c-2333-48e9-b92e-47d15d740bf0 1073741824" returned: 0 in 0.732s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5bdf349-10e0-49ce-a78f-e3766e83e00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1213534243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34dc7a8-1fbb-4ae9-94dd-091740b877d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f61c73705c4eaabbedf3b434588302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:20Z,use_quota=True,user_id='777d7c51704f4563a99335bdb46d6460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f548ac5-ec43-4bdf-9db1-615e993fb002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f548ac5-ec43-4bdf-9db1-615e993fb002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6605bf3a-38e5-4e3d-a13f-cd6bbd895b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6605bf3a-38e5-4e3d-a13f-cd6bbd895b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a34dc7a8-1fbb-4ae9-94dd-091740b877d4', 'volume_name': 'volume-a34dc7a8-1fbb-4ae9-94dd-091740b877d4', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b62e06-1278-4715-a72f-5eb7d8924b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b62e06-1278-4715-a72f-5eb7d8924b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db3cd39-bedc-4b5c-a4f7-fb049ae16c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:20 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Volume a34dc7a8-1fbb-4ae9-94dd-091740b877d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a34dc7a8-1fbb-4ae9-94dd-091740b877d4', 'volume_size': 1} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8992b84c-2333-48e9-b92e-47d15d740bf0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:20 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8992b84c-2333-48e9-b92e-47d15d740bf0 Sep 06 08:15:20 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:20 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8992b84c-2333-48e9-b92e-47d15d740bf0" returned: 0 in 0.309s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.665s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1508687978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f46b8899-57d9-4e63-8226-2d077f7659c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f61c73705c4eaabbedf3b434588302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:19Z,use_quota=True,user_id='777d7c51704f4563a99335bdb46d6460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Creating volume f46b8899-57d9-4e63-8226-2d077f7659c2 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:15:20 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f46b8899-57d9-4e63-8226-2d077f7659c2 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b731e828-3611-475a-881f-72199c3ca19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8992b84c-2333-48e9-b92e-47d15d740bf0', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a3efc7-ab3b-4767-b862-aea303b5fe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:20 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f46b8899-57d9-4e63-8226-2d077f7659c2 1073741824 Sep 06 08:15:20 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:20 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Volume volume-8992b84c-2333-48e9-b92e-47d15d740bf0 (8992b84c-2333-48e9-b92e-47d15d740bf0): created successfully Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a3efc7-ab3b-4767-b862-aea303b5fe97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Flow 'volume_create_manager' (7ebcec96-6067-410b-a944-b3ec9d6bacf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:20 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-40664de4-6572-4be4-92c3-a2f8f239b824 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Created volume successfully. Sep 06 08:15:21 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f46b8899-57d9-4e63-8226-2d077f7659c2 1073741824" returned: 0 in 0.608s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f46b8899-57d9-4e63-8226-2d077f7659c2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:21 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f46b8899-57d9-4e63-8226-2d077f7659c2 Sep 06 08:15:21 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:21 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f46b8899-57d9-4e63-8226-2d077f7659c2" returned: 0 in 0.281s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:15:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.750s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-565086412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d233beb-5f9f-4769-a475-8ef182290be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f61c73705c4eaabbedf3b434588302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:20Z,use_quota=True,user_id='777d7c51704f4563a99335bdb46d6460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:15:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Creating volume 0d233beb-5f9f-4769-a475-8ef182290be9 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:15:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:15:21 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:15:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0d233beb-5f9f-4769-a475-8ef182290be9 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:21 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0d233beb-5f9f-4769-a475-8ef182290be9 1073741824 Sep 06 08:15:21 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ede6aa-7e92-45ea-9e08-c7347814f8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f46b8899-57d9-4e63-8226-2d077f7659c2', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d18a3beb-b0db-4ad6-b32d-febd345062d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:21 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Volume volume-f46b8899-57d9-4e63-8226-2d077f7659c2 (f46b8899-57d9-4e63-8226-2d077f7659c2): created successfully Sep 06 08:15:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d18a3beb-b0db-4ad6-b32d-febd345062d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Flow 'volume_create_manager' (091dcb14-36b0-4b4e-91fe-17223c4b938d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:21 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-55d846e6-1fe0-4fb7-9edb-95bd45960d97 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Created volume successfully. Sep 06 08:15:22 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0d233beb-5f9f-4769-a475-8ef182290be9 1073741824" returned: 0 in 0.574s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0d233beb-5f9f-4769-a475-8ef182290be9 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:22 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0d233beb-5f9f-4769-a475-8ef182290be9 Sep 06 08:15:22 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:22 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0d233beb-5f9f-4769-a475-8ef182290be9" returned: 0 in 0.386s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:22 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:15:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.317s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:22 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1213534243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34dc7a8-1fbb-4ae9-94dd-091740b877d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f61c73705c4eaabbedf3b434588302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:20Z,use_quota=True,user_id='777d7c51704f4563a99335bdb46d6460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:15:22 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Creating volume a34dc7a8-1fbb-4ae9-94dd-091740b877d4 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:15:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:22 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:22 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:22 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:15:22 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:15:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a34dc7a8-1fbb-4ae9-94dd-091740b877d4 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:22 devstack sudo[101094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a34dc7a8-1fbb-4ae9-94dd-091740b877d4 1073741824 Sep 06 08:15:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07793ba9-4b8e-473a-b854-16cbc3b7f760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d233beb-5f9f-4769-a475-8ef182290be9', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:22 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61f7b00-f7ce-42d4-be96-6534aa1114c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:22 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Volume volume-0d233beb-5f9f-4769-a475-8ef182290be9 (0d233beb-5f9f-4769-a475-8ef182290be9): created successfully Sep 06 08:15:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61f7b00-f7ce-42d4-be96-6534aa1114c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Flow 'volume_create_manager' (aebc93b1-46cf-426a-9b4f-b5d8aa14371e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:22 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-180f902c-464a-4931-bd26-2afcda7801fd tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Created volume successfully. Sep 06 08:15:23 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a34dc7a8-1fbb-4ae9-94dd-091740b877d4 1073741824" returned: 0 in 0.512s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a34dc7a8-1fbb-4ae9-94dd-091740b877d4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:23 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a34dc7a8-1fbb-4ae9-94dd-091740b877d4 Sep 06 08:15:23 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:23 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a34dc7a8-1fbb-4ae9-94dd-091740b877d4" returned: 0 in 0.332s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:15:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db3cd39-bedc-4b5c-a4f7-fb049ae16c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a34dc7a8-1fbb-4ae9-94dd-091740b877d4', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbc57277-bffb-4071-8c86-040f5ed89685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:23 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Volume volume-a34dc7a8-1fbb-4ae9-94dd-091740b877d4 (a34dc7a8-1fbb-4ae9-94dd-091740b877d4): created successfully Sep 06 08:15:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbc57277-bffb-4071-8c86-040f5ed89685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Flow 'volume_create_manager' (3aecaaac-dc67-4b4e-be5c-20a698af2084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:23 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-5887f5fc-ba08-4351-a427-1ea6ae2141cc tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Created volume successfully. Sep 06 08:15:24 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e0287799-be04-4f28-ac73-99387bc152b0 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "cinder-a34dc7a8-1fbb-4ae9-94dd-091740b877d4-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:24 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e0287799-be04-4f28-ac73-99387bc152b0 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "cinder-a34dc7a8-1fbb-4ae9-94dd-091740b877d4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:24 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e0287799-be04-4f28-ac73-99387bc152b0 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "cinder-quobyte-a34dc7a8-1fbb-4ae9-94dd-091740b877d4" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:24 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e0287799-be04-4f28-ac73-99387bc152b0 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "cinder-quobyte-a34dc7a8-1fbb-4ae9-94dd-091740b877d4" acquired by "delete_volume" :: waited 0.021s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:25 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca79478a-d9a3-4fa8-a127-cc3206e17cdb]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:15:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e0287799-be04-4f28-ac73-99387bc152b0 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a34dc7a8-1fbb-4ae9-94dd-091740b877d4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:25 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a34dc7a8-1fbb-4ae9-94dd-091740b877d4 Sep 06 08:15:25 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:25 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e0287799-be04-4f28-ac73-99387bc152b0 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a34dc7a8-1fbb-4ae9-94dd-091740b877d4" returned: 0 in 0.371s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e0287799-be04-4f28-ac73-99387bc152b0 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a34dc7a8-1fbb-4ae9-94dd-091740b877d4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:25 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a34dc7a8-1fbb-4ae9-94dd-091740b877d4 Sep 06 08:15:25 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:25 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e0287799-be04-4f28-ac73-99387bc152b0 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a34dc7a8-1fbb-4ae9-94dd-091740b877d4" returned: 0 in 0.260s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:25 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e0287799-be04-4f28-ac73-99387bc152b0 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "cinder-quobyte-a34dc7a8-1fbb-4ae9-94dd-091740b877d4" released by "delete_volume" :: held 0.684s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:25 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=93,cinder:UPDATE=118,cinder:INSERT=26,cinder:DELETE=8 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:15:25 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-e0287799-be04-4f28-ac73-99387bc152b0 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Created reservations ['197ee4aa-6e9c-4d8e-a138-0b938a705b71', 'f01c957c-b292-4c24-9724-7370695a485b', '257ac14a-283b-4683-abdb-eced7f56c8d6', 'd8879ad5-9be9-4283-a7ab-7b5918f6299a'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:15:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e0287799-be04-4f28-ac73-99387bc152b0 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e0287799-be04-4f28-ac73-99387bc152b0 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:25 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e0287799-be04-4f28-ac73-99387bc152b0 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:25 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e0287799-be04-4f28-ac73-99387bc152b0 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e0287799-be04-4f28-ac73-99387bc152b0 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e0287799-be04-4f28-ac73-99387bc152b0 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:25 devstack sudo[101112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:15:25 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:26 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e0287799-be04-4f28-ac73-99387bc152b0 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.304s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:26 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-e0287799-be04-4f28-ac73-99387bc152b0 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:15:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ca136af2-3f66-4f63-9e36-b28e9f91d64b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "cinder-0d233beb-5f9f-4769-a475-8ef182290be9-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:26 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e0287799-be04-4f28-ac73-99387bc152b0 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Deleted volume successfully. Sep 06 08:15:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e0287799-be04-4f28-ac73-99387bc152b0 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "cinder-a34dc7a8-1fbb-4ae9-94dd-091740b877d4-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ca136af2-3f66-4f63-9e36-b28e9f91d64b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "cinder-0d233beb-5f9f-4769-a475-8ef182290be9-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ca136af2-3f66-4f63-9e36-b28e9f91d64b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "cinder-quobyte-0d233beb-5f9f-4769-a475-8ef182290be9" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ca136af2-3f66-4f63-9e36-b28e9f91d64b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "cinder-quobyte-0d233beb-5f9f-4769-a475-8ef182290be9" acquired by "delete_volume" :: waited 0.016s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:26 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cea3d2-3829-437d-9767-472d7ae3f17b]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:15:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ca136af2-3f66-4f63-9e36-b28e9f91d64b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0d233beb-5f9f-4769-a475-8ef182290be9 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:26 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0d233beb-5f9f-4769-a475-8ef182290be9 Sep 06 08:15:26 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:26 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ca136af2-3f66-4f63-9e36-b28e9f91d64b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0d233beb-5f9f-4769-a475-8ef182290be9" returned: 0 in 0.410s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ca136af2-3f66-4f63-9e36-b28e9f91d64b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0d233beb-5f9f-4769-a475-8ef182290be9 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:26 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0d233beb-5f9f-4769-a475-8ef182290be9 Sep 06 08:15:26 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:27 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ca136af2-3f66-4f63-9e36-b28e9f91d64b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0d233beb-5f9f-4769-a475-8ef182290be9" returned: 0 in 0.315s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ca136af2-3f66-4f63-9e36-b28e9f91d64b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "cinder-quobyte-0d233beb-5f9f-4769-a475-8ef182290be9" released by "delete_volume" :: held 0.784s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:27 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-ca136af2-3f66-4f63-9e36-b28e9f91d64b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Created reservations ['1317781b-7546-4eae-ae80-a4aff1bc243e', '124ae3d3-8759-43ce-8016-4c4e12813497', '9594ff83-c189-4a76-86c6-3276438b2546', 'e0d27177-40bb-4eba-a54f-69ad024e2d13'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:15:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ca136af2-3f66-4f63-9e36-b28e9f91d64b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ca136af2-3f66-4f63-9e36-b28e9f91d64b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ca136af2-3f66-4f63-9e36-b28e9f91d64b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ca136af2-3f66-4f63-9e36-b28e9f91d64b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ca136af2-3f66-4f63-9e36-b28e9f91d64b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ca136af2-3f66-4f63-9e36-b28e9f91d64b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:27 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:15:27 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7cfe418b-3fe6-4301-893c-4e4691fe8ea5 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "cinder-f46b8899-57d9-4e63-8226-2d077f7659c2-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7cfe418b-3fe6-4301-893c-4e4691fe8ea5 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "cinder-f46b8899-57d9-4e63-8226-2d077f7659c2-delete_volume" acquired by "delete_volume" :: waited 0.128s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:27 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ca136af2-3f66-4f63-9e36-b28e9f91d64b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.329s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:27 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-ca136af2-3f66-4f63-9e36-b28e9f91d64b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:15:27 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-ca136af2-3f66-4f63-9e36-b28e9f91d64b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Deleted volume successfully. Sep 06 08:15:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7cfe418b-3fe6-4301-893c-4e4691fe8ea5 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "cinder-quobyte-f46b8899-57d9-4e63-8226-2d077f7659c2" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ca136af2-3f66-4f63-9e36-b28e9f91d64b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "cinder-0d233beb-5f9f-4769-a475-8ef182290be9-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7cfe418b-3fe6-4301-893c-4e4691fe8ea5 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "cinder-quobyte-f46b8899-57d9-4e63-8226-2d077f7659c2" acquired by "delete_volume" :: waited 0.033s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:27 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b34fbda-39ed-43dd-b309-60e97e8a7687]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:15:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7cfe418b-3fe6-4301-893c-4e4691fe8ea5 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f46b8899-57d9-4e63-8226-2d077f7659c2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:27 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f46b8899-57d9-4e63-8226-2d077f7659c2 Sep 06 08:15:27 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:28 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7cfe418b-3fe6-4301-893c-4e4691fe8ea5 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f46b8899-57d9-4e63-8226-2d077f7659c2" returned: 0 in 0.414s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7cfe418b-3fe6-4301-893c-4e4691fe8ea5 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f46b8899-57d9-4e63-8226-2d077f7659c2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:28 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f46b8899-57d9-4e63-8226-2d077f7659c2 Sep 06 08:15:28 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:28 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7cfe418b-3fe6-4301-893c-4e4691fe8ea5 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f46b8899-57d9-4e63-8226-2d077f7659c2" returned: 0 in 0.283s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7cfe418b-3fe6-4301-893c-4e4691fe8ea5 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "cinder-quobyte-f46b8899-57d9-4e63-8226-2d077f7659c2" released by "delete_volume" :: held 0.743s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:28 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-7cfe418b-3fe6-4301-893c-4e4691fe8ea5 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Created reservations ['ca4b61b5-07c0-4018-a34e-258a62f2986d', '7f692bf5-55ae-4153-87ea-6e3d8da52086', 'a8d14fc9-b62f-44fe-9d2e-1124ba025e23', 'b3f1ac81-ea0c-43c7-976a-66b04f0f17cf'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:15:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7cfe418b-3fe6-4301-893c-4e4691fe8ea5 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7cfe418b-3fe6-4301-893c-4e4691fe8ea5 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:28 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7cfe418b-3fe6-4301-893c-4e4691fe8ea5 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:28 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7cfe418b-3fe6-4301-893c-4e4691fe8ea5 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7cfe418b-3fe6-4301-893c-4e4691fe8ea5 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7cfe418b-3fe6-4301-893c-4e4691fe8ea5 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:28 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:15:28 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ebb1bb0d-0cee-481b-aac6-b4a53610dd47 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "cinder-8992b84c-2333-48e9-b92e-47d15d740bf0-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ebb1bb0d-0cee-481b-aac6-b4a53610dd47 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "cinder-8992b84c-2333-48e9-b92e-47d15d740bf0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ebb1bb0d-0cee-481b-aac6-b4a53610dd47 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "cinder-quobyte-8992b84c-2333-48e9-b92e-47d15d740bf0" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ebb1bb0d-0cee-481b-aac6-b4a53610dd47 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "cinder-quobyte-8992b84c-2333-48e9-b92e-47d15d740bf0" acquired by "delete_volume" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:28 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f57a13-69de-4487-9033-6191f52b5acb]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:15:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ebb1bb0d-0cee-481b-aac6-b4a53610dd47 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8992b84c-2333-48e9-b92e-47d15d740bf0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:28 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7cfe418b-3fe6-4301-893c-4e4691fe8ea5 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.322s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:28 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-7cfe418b-3fe6-4301-893c-4e4691fe8ea5 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:15:28 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-7cfe418b-3fe6-4301-893c-4e4691fe8ea5 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Deleted volume successfully. Sep 06 08:15:28 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8992b84c-2333-48e9-b92e-47d15d740bf0 Sep 06 08:15:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7cfe418b-3fe6-4301-893c-4e4691fe8ea5 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "cinder-f46b8899-57d9-4e63-8226-2d077f7659c2-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:28 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:29 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ebb1bb0d-0cee-481b-aac6-b4a53610dd47 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8992b84c-2333-48e9-b92e-47d15d740bf0" returned: 0 in 0.402s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ebb1bb0d-0cee-481b-aac6-b4a53610dd47 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8992b84c-2333-48e9-b92e-47d15d740bf0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:29 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8992b84c-2333-48e9-b92e-47d15d740bf0 Sep 06 08:15:29 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:29 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ebb1bb0d-0cee-481b-aac6-b4a53610dd47 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-8992b84c-2333-48e9-b92e-47d15d740bf0" returned: 0 in 0.262s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ebb1bb0d-0cee-481b-aac6-b4a53610dd47 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "cinder-quobyte-8992b84c-2333-48e9-b92e-47d15d740bf0" released by "delete_volume" :: held 0.707s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:29 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-ebb1bb0d-0cee-481b-aac6-b4a53610dd47 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Created reservations ['30dff323-68d4-4e6f-be5f-743e14a86122', '8fd923c4-15d7-4cfd-9464-d91dfef63332', '1533d10c-14e6-4580-a9fe-4e5c22f2decf', '66aeabd4-75bf-4e34-8b9c-5786bf861da3'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:15:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ebb1bb0d-0cee-481b-aac6-b4a53610dd47 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ebb1bb0d-0cee-481b-aac6-b4a53610dd47 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ebb1bb0d-0cee-481b-aac6-b4a53610dd47 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ebb1bb0d-0cee-481b-aac6-b4a53610dd47 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ebb1bb0d-0cee-481b-aac6-b4a53610dd47 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ebb1bb0d-0cee-481b-aac6-b4a53610dd47 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:29 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:15:29 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:29 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ccc4b9b8-2f63-4b7f-98cd-21293c4e662b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "cinder-9530923e-0ef6-4656-b7d8-4dd58382f219-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ebb1bb0d-0cee-481b-aac6-b4a53610dd47 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.270s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:29 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-ebb1bb0d-0cee-481b-aac6-b4a53610dd47 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:15:29 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-ebb1bb0d-0cee-481b-aac6-b4a53610dd47 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Deleted volume successfully. Sep 06 08:15:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ccc4b9b8-2f63-4b7f-98cd-21293c4e662b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "cinder-9530923e-0ef6-4656-b7d8-4dd58382f219-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ebb1bb0d-0cee-481b-aac6-b4a53610dd47 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "cinder-8992b84c-2333-48e9-b92e-47d15d740bf0-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ccc4b9b8-2f63-4b7f-98cd-21293c4e662b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "cinder-quobyte-9530923e-0ef6-4656-b7d8-4dd58382f219" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ccc4b9b8-2f63-4b7f-98cd-21293c4e662b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "cinder-quobyte-9530923e-0ef6-4656-b7d8-4dd58382f219" acquired by "delete_volume" :: waited 0.017s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:29 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa5376e-9775-413e-b999-a4e085e8d99d]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:15:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ccc4b9b8-2f63-4b7f-98cd-21293c4e662b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9530923e-0ef6-4656-b7d8-4dd58382f219 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:30 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9530923e-0ef6-4656-b7d8-4dd58382f219 Sep 06 08:15:30 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:30 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ccc4b9b8-2f63-4b7f-98cd-21293c4e662b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9530923e-0ef6-4656-b7d8-4dd58382f219" returned: 0 in 0.393s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ccc4b9b8-2f63-4b7f-98cd-21293c4e662b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9530923e-0ef6-4656-b7d8-4dd58382f219 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:30 devstack sudo[101168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9530923e-0ef6-4656-b7d8-4dd58382f219 Sep 06 08:15:30 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:30 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:15:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Flow 'volume_create_manager' (3d763600-53e5-4a40-8fd6-8e61e4281493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee701a7f-00e8-464f-a6eb-dc819614bda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee701a7f-00e8-464f-a6eb-dc819614bda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-945490114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04740454-152a-4921-b011-4e48999c64ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3cde22e9244c6889cc6bb73421665a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:31Z,use_quota=True,user_id='082554da37be43cb92327214de98f01f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:30 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a271c236-3e51-4df6-9eaf-92fb5cb64804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a271c236-3e51-4df6-9eaf-92fb5cb64804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbdc252d-6325-4246-a631-ad654f91ce74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:30 devstack cinder-volume[87307]: DEBUG cinder.image.glance [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Creating Keystone auth plugin from conf {{(pid=87307) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 08:15:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ccc4b9b8-2f63-4b7f-98cd-21293c4e662b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9530923e-0ef6-4656-b7d8-4dd58382f219" returned: 0 in 0.282s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:30 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ccc4b9b8-2f63-4b7f-98cd-21293c4e662b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "cinder-quobyte-9530923e-0ef6-4656-b7d8-4dd58382f219" released by "delete_volume" :: held 0.718s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:30 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-ccc4b9b8-2f63-4b7f-98cd-21293c4e662b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Created reservations ['460d8abd-7c50-4a1d-8ac6-b2caf232b9e5', '6996b0a3-7660-4ecd-ba21-0ab57f861e14', '8bfe9482-2b77-4c3b-a5c7-3b621c29518e', '4e027a3d-6e09-4826-a0ae-7f7a2925e645'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:15:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ccc4b9b8-2f63-4b7f-98cd-21293c4e662b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ccc4b9b8-2f63-4b7f-98cd-21293c4e662b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:30 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ccc4b9b8-2f63-4b7f-98cd-21293c4e662b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:30 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ccc4b9b8-2f63-4b7f-98cd-21293c4e662b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ccc4b9b8-2f63-4b7f-98cd-21293c4e662b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ccc4b9b8-2f63-4b7f-98cd-21293c4e662b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:30 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:15:30 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbdc252d-6325-4246-a631-ad654f91ce74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '04740454-152a-4921-b011-4e48999c64ed', 'volume_name': 'volume-04740454-152a-4921-b011-4e48999c64ed', 'volume_size': 1, 'image_id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1531709cfd9f41a0b45e9cae3f8241b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'created_at': datetime.datetime(2026, 9, 6, 5, 57, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 5, 57, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14eb594-21fa-4d47-afd2-b52f43a5a54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14eb594-21fa-4d47-afd2-b52f43a5a54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697c9c87-4a8d-4abb-8ade-8e6cc4706963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:30 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Volume 04740454-152a-4921-b011-4e48999c64ed: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-04740454-152a-4921-b011-4e48999c64ed', 'volume_size': 1, 'image_id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1531709cfd9f41a0b45e9cae3f8241b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'created_at': datetime.datetime(2026, 9, 6, 5, 57, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 5, 57, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 06 08:15:30 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Trying to clone 04740454-152a-4921-b011-4e48999c64ed from image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}]). {{(pid=87307) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 08:15:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1afbdb36-2b4f-48e0-b654-50cf17d5f078 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "cinder-35e8b434-a71c-4cce-9990-cb2cc6c3569e-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:31 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ccc4b9b8-2f63-4b7f-98cd-21293c4e662b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.290s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:31 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-ccc4b9b8-2f63-4b7f-98cd-21293c4e662b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:15:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1afbdb36-2b4f-48e0-b654-50cf17d5f078 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "cinder-35e8b434-a71c-4cce-9990-cb2cc6c3569e-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:31 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-ccc4b9b8-2f63-4b7f-98cd-21293c4e662b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Deleted volume successfully. Sep 06 08:15:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ccc4b9b8-2f63-4b7f-98cd-21293c4e662b tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "cinder-9530923e-0ef6-4656-b7d8-4dd58382f219-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1afbdb36-2b4f-48e0-b654-50cf17d5f078 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "cinder-quobyte-35e8b434-a71c-4cce-9990-cb2cc6c3569e" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1afbdb36-2b4f-48e0-b654-50cf17d5f078 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "cinder-quobyte-35e8b434-a71c-4cce-9990-cb2cc6c3569e" acquired by "delete_volume" :: waited 0.032s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:31 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[da266731-d210-49ab-82d9-7fff931d4389]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:15:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1afbdb36-2b4f-48e0-b654-50cf17d5f078 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-35e8b434-a71c-4cce-9990-cb2cc6c3569e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:31 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_iomx_od1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 08:15:31 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Image download 20.69 MB at 20.69 MB/s Sep 06 08:15:31 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f1f3d7-1ab0-4881-8351-a080732098a3]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:15:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_iomx_od1devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:31 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-35e8b434-a71c-4cce-9990-cb2cc6c3569e Sep 06 08:15:31 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:31 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_iomx_od1devstack@QuobyteHD Sep 06 08:15:31 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:31 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1afbdb36-2b4f-48e0-b654-50cf17d5f078 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-35e8b434-a71c-4cce-9990-cb2cc6c3569e" returned: 0 in 0.370s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1afbdb36-2b4f-48e0-b654-50cf17d5f078 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-35e8b434-a71c-4cce-9990-cb2cc6c3569e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:31 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-35e8b434-a71c-4cce-9990-cb2cc6c3569e Sep 06 08:15:31 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:31 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_iomx_od1devstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:31 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Temporary image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 is fetched for user 082554da37be43cb92327214de98f01f. {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 08:15:31 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[62633f5f-996b-4dfc-84b3-dc239d575b5c]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:15:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_iomx_od1devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:31 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:31 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_iomx_od1devstack@QuobyteHD Sep 06 08:15:31 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1afbdb36-2b4f-48e0-b654-50cf17d5f078 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-35e8b434-a71c-4cce-9990-cb2cc6c3569e" returned: 0 in 0.262s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1afbdb36-2b4f-48e0-b654-50cf17d5f078 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "cinder-quobyte-35e8b434-a71c-4cce-9990-cb2cc6c3569e" released by "delete_volume" :: held 0.685s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:31 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-1afbdb36-2b4f-48e0-b654-50cf17d5f078 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Created reservations ['ba09be15-bb13-417c-bf8d-83ad78214206', '5bdce98b-8140-4189-b376-e9e8f27d6115', '83a953d9-8983-43a5-9670-4378d1add136', '217377c5-f98a-492d-8f74-4944a8c5a7d6'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:15:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1afbdb36-2b4f-48e0-b654-50cf17d5f078 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1afbdb36-2b4f-48e0-b654-50cf17d5f078 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1afbdb36-2b4f-48e0-b654-50cf17d5f078 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1afbdb36-2b4f-48e0-b654-50cf17d5f078 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1afbdb36-2b4f-48e0-b654-50cf17d5f078 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1afbdb36-2b4f-48e0-b654-50cf17d5f078 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:32 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:15:32 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:32 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_iomx_od1devstack@QuobyteHD" returned: 0 in 0.329s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-945490114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04740454-152a-4921-b011-4e48999c64ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3cde22e9244c6889cc6bb73421665a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:31Z,use_quota=True,user_id='082554da37be43cb92327214de98f01f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Creating volume 04740454-152a-4921-b011-4e48999c64ed {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:15:32 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-04740454-152a-4921-b011-4e48999c64ed 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:32 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-04740454-152a-4921-b011-4e48999c64ed 1073741824 Sep 06 08:15:32 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:32 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1afbdb36-2b4f-48e0-b654-50cf17d5f078 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.262s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-1afbdb36-2b4f-48e0-b654-50cf17d5f078 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:15:32 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-1afbdb36-2b4f-48e0-b654-50cf17d5f078 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Deleted volume successfully. Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1afbdb36-2b4f-48e0-b654-50cf17d5f078 tempest-CreateVolumesFromSourceVolumeTest-1999267523 None] Lock "cinder-35e8b434-a71c-4cce-9990-cb2cc6c3569e-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:32 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-04740454-152a-4921-b011-4e48999c64ed 1073741824" returned: 0 in 0.437s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-04740454-152a-4921-b011-4e48999c64ed {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:32 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-04740454-152a-4921-b011-4e48999c64ed Sep 06 08:15:32 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:32 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-04740454-152a-4921-b011-4e48999c64ed" returned: 0 in 0.282s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Attempting download of 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}])) to volume 04740454-152a-4921-b011-4e48999c64ed. {{(pid=87307) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[36694da0-b2f6-479f-bc05-85dba5566c7b]: (4, 'raw') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:15:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_kmk2_p5i {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:33 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_kmk2_p5i Sep 06 08:15:33 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:33 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_kmk2_p5i" returned: 0 in 0.343s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_kmk2_p5i {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:33 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_kmk2_p5i Sep 06 08:15:33 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:33 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_kmk2_p5i" returned: 1 in 0.359s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_kmk2_p5i' failed. Not Retrying. {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 08:15:33 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32550e1-a01f-42af-94ea-1a90055c74c0]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:15:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_iomx_od1devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:33 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_iomx_od1devstack@QuobyteHD Sep 06 08:15:33 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:33 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_iomx_od1devstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:34 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 was qcow2, converting to qcow2 {{(pid=87307) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 08:15:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_iomx_od1devstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-04740454-152a-4921-b011-4e48999c64ed {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:34 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_iomx_od1devstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-04740454-152a-4921-b011-4e48999c64ed Sep 06 08:15:34 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=130,cinder:UPDATE=160,cinder:INSERT=36,cinder:DELETE=16 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Flow 'volume_create_manager' (532f9743-a0e3-4ae8-a463-9d609f8e7b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb32267-0203-4fe8-ae67-4e3a642b1dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb32267-0203-4fe8-ae67-4e3a642b1dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09353545-8ec5-43fd-ac35-ac7a0857a548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49f1b12b47f24f34910b2712f865af36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:35Z,use_quota=True,user_id='3c380a583a934aa68877fb83e8d04b30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a96701d-3da3-429f-9e46-1cabc82e2535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a96701d-3da3-429f-9e46-1cabc82e2535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c787ed-b81a-4224-aae9-91c42f1c3f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c787ed-b81a-4224-aae9-91c42f1c3f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09353545-8ec5-43fd-ac35-ac7a0857a548', 'volume_name': 'volume-09353545-8ec5-43fd-ac35-ac7a0857a548', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727e8c18-6a37-4d8c-8039-8c7be8fe9134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727e8c18-6a37-4d8c-8039-8c7be8fe9134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9271e548-ad30-47a8-b26e-ec448b34d50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:35 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Volume 09353545-8ec5-43fd-ac35-ac7a0857a548: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09353545-8ec5-43fd-ac35-ac7a0857a548', 'volume_size': 1} Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09353545-8ec5-43fd-ac35-ac7a0857a548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49f1b12b47f24f34910b2712f865af36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:35Z,use_quota=True,user_id='3c380a583a934aa68877fb83e8d04b30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Creating volume 09353545-8ec5-43fd-ac35-ac7a0857a548 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:15:35 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-09353545-8ec5-43fd-ac35-ac7a0857a548 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:35 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-09353545-8ec5-43fd-ac35-ac7a0857a548 1073741824 Sep 06 08:15:35 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:35 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_iomx_od1devstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-04740454-152a-4921-b011-4e48999c64ed" returned: 0 in 1.769s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2_iomx_od1devstack@QuobyteHD, size 112.00 MB, duration 1.77 sec, destination /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-04740454-152a-4921-b011-4e48999c64ed {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:15:35 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Converted 112.00 MB image at 63.26 MB/s Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-04740454-152a-4921-b011-4e48999c64ed 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:35 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-04740454-152a-4921-b011-4e48999c64ed 1G Sep 06 08:15:35 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:35 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-09353545-8ec5-43fd-ac35-ac7a0857a548 1073741824" returned: 0 in 0.508s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-09353545-8ec5-43fd-ac35-ac7a0857a548 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:35 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-09353545-8ec5-43fd-ac35-ac7a0857a548 Sep 06 08:15:35 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:36 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-04740454-152a-4921-b011-4e48999c64ed 1G" returned: 0 in 0.373s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:36 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Downloaded image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}])) to volume 04740454-152a-4921-b011-4e48999c64ed successfully. {{(pid=87307) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 08:15:36 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Temporary image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 for user 082554da37be43cb92327214de98f01f is deleted. {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 08:15:36 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Marking volume 04740454-152a-4921-b011-4e48999c64ed as bootable. {{(pid=87307) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 08:15:36 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Copying metadata from image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 to 04740454-152a-4921-b011-4e48999c64ed. {{(pid=87307) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 08:15:36 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Creating volume glance metadata for volume 04740454-152a-4921-b011-4e48999c64ed backed by image 6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87307) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 08:15:36 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-09353545-8ec5-43fd-ac35-ac7a0857a548" returned: 0 in 0.295s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:36 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:15:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9271e548-ad30-47a8-b26e-ec448b34d50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09353545-8ec5-43fd-ac35-ac7a0857a548', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6e4324-31d6-4030-9520-9e55405ae157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:36 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Volume volume-09353545-8ec5-43fd-ac35-ac7a0857a548 (09353545-8ec5-43fd-ac35-ac7a0857a548): created successfully Sep 06 08:15:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6e4324-31d6-4030-9520-9e55405ae157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Flow 'volume_create_manager' (532f9743-a0e3-4ae8-a463-9d609f8e7b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:36 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-c10c5a5b-84b0-4463-9119-0c57d8cc0263 tempest-CinderUnicodeTest-1206583602 None] Created volume successfully. Sep 06 08:15:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697c9c87-4a8d-4abb-8ade-8e6cc4706963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04740454-152a-4921-b011-4e48999c64ed', 'volume_size': 1, 'image_id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1531709cfd9f41a0b45e9cae3f8241b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2', 'created_at': datetime.datetime(2026, 9, 6, 5, 57, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 5, 57, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6fcddb8d-ab3a-4890-82a7-83a3a28fa1f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ad0807-2f15-4ec5-b070-f06e3b9177c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:36 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Volume volume-04740454-152a-4921-b011-4e48999c64ed (04740454-152a-4921-b011-4e48999c64ed): created successfully Sep 06 08:15:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ad0807-2f15-4ec5-b070-f06e3b9177c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Flow 'volume_create_manager' (3d763600-53e5-4a40-8fd6-8e61e4281493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:36 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-efc1c216-30ec-4f8e-a091-796c2beacf99 tempest-VolumesImageMetadata-114273561 None] Created volume successfully. Sep 06 08:15:37 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9f8fbf5a-3a04-4451-8190-2d15f2b4e60e tempest-VolumesImageMetadata-114273561 None] Acquiring lock "cinder-04740454-152a-4921-b011-4e48999c64ed-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:37 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9f8fbf5a-3a04-4451-8190-2d15f2b4e60e tempest-VolumesImageMetadata-114273561 None] Lock "cinder-04740454-152a-4921-b011-4e48999c64ed-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:37 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9f8fbf5a-3a04-4451-8190-2d15f2b4e60e tempest-VolumesImageMetadata-114273561 None] Acquiring lock "cinder-quobyte-04740454-152a-4921-b011-4e48999c64ed" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:37 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9f8fbf5a-3a04-4451-8190-2d15f2b4e60e tempest-VolumesImageMetadata-114273561 None] Lock "cinder-quobyte-04740454-152a-4921-b011-4e48999c64ed" acquired by "delete_volume" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:37 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c43e2e-6ca3-464b-af00-50cc01d5b0bf]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:15:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9f8fbf5a-3a04-4451-8190-2d15f2b4e60e tempest-VolumesImageMetadata-114273561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-04740454-152a-4921-b011-4e48999c64ed {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:37 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-04740454-152a-4921-b011-4e48999c64ed Sep 06 08:15:37 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:37 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:15:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Flow 'volume_create_manager' (cd8ce40d-4d80-4d67-a7b7-c13c4cca4c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f11d90e-3ec2-4dc4-802f-92a570cf16b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:37 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f11d90e-3ec2-4dc4-802f-92a570cf16b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1050970729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6fa8772-b652-418d-860c-aceebf65e38e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49f1b12b47f24f34910b2712f865af36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:38Z,use_quota=True,user_id='3c380a583a934aa68877fb83e8d04b30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c59509-df16-4193-a098-2e0f5429bbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c59509-df16-4193-a098-2e0f5429bbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35c275d-8afd-4cc5-8c27-c9e89c630cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35c275d-8afd-4cc5-8c27-c9e89c630cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6fa8772-b652-418d-860c-aceebf65e38e', 'volume_name': 'volume-a6fa8772-b652-418d-860c-aceebf65e38e', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d325a2fe-2ae8-4a0b-9135-9d565f3651d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d325a2fe-2ae8-4a0b-9135-9d565f3651d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72e15b47-6e6e-4664-87cb-6c4332e368b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:38 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Volume a6fa8772-b652-418d-860c-aceebf65e38e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6fa8772-b652-418d-860c-aceebf65e38e', 'volume_size': 1} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1050970729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6fa8772-b652-418d-860c-aceebf65e38e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49f1b12b47f24f34910b2712f865af36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:38Z,use_quota=True,user_id='3c380a583a934aa68877fb83e8d04b30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Creating volume a6fa8772-b652-418d-860c-aceebf65e38e {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:15:38 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9f8fbf5a-3a04-4451-8190-2d15f2b4e60e tempest-VolumesImageMetadata-114273561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-04740454-152a-4921-b011-4e48999c64ed" returned: 0 in 0.531s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9f8fbf5a-3a04-4451-8190-2d15f2b4e60e tempest-VolumesImageMetadata-114273561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-04740454-152a-4921-b011-4e48999c64ed {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:38 devstack sudo[101248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e 1073741824 Sep 06 08:15:38 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:38 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-04740454-152a-4921-b011-4e48999c64ed Sep 06 08:15:38 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:38 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9f8fbf5a-3a04-4451-8190-2d15f2b4e60e tempest-VolumesImageMetadata-114273561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-04740454-152a-4921-b011-4e48999c64ed" returned: 0 in 0.279s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9f8fbf5a-3a04-4451-8190-2d15f2b4e60e tempest-VolumesImageMetadata-114273561 None] Lock "cinder-quobyte-04740454-152a-4921-b011-4e48999c64ed" released by "delete_volume" :: held 0.857s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-9f8fbf5a-3a04-4451-8190-2d15f2b4e60e tempest-VolumesImageMetadata-114273561 None] Created reservations ['8b9be9ee-d839-492a-b521-3b5d67cd58b2', 'a5a0d91a-2e08-4fb8-83b1-4e1121e6e87c', '5c3d709a-6423-4c8f-9549-6e70507c0395', '97853f3a-aacc-443a-a98b-bdf517d9d5f2'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9f8fbf5a-3a04-4451-8190-2d15f2b4e60e tempest-VolumesImageMetadata-114273561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9f8fbf5a-3a04-4451-8190-2d15f2b4e60e tempest-VolumesImageMetadata-114273561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9f8fbf5a-3a04-4451-8190-2d15f2b4e60e tempest-VolumesImageMetadata-114273561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9f8fbf5a-3a04-4451-8190-2d15f2b4e60e tempest-VolumesImageMetadata-114273561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9f8fbf5a-3a04-4451-8190-2d15f2b4e60e tempest-VolumesImageMetadata-114273561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9f8fbf5a-3a04-4451-8190-2d15f2b4e60e tempest-VolumesImageMetadata-114273561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:38 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:15:38 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:38 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e 1073741824" returned: 0 in 0.554s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:38 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e Sep 06 08:15:38 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:38 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9f8fbf5a-3a04-4451-8190-2d15f2b4e60e tempest-VolumesImageMetadata-114273561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.426s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-9f8fbf5a-3a04-4451-8190-2d15f2b4e60e tempest-VolumesImageMetadata-114273561 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:15:38 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-9f8fbf5a-3a04-4451-8190-2d15f2b4e60e tempest-VolumesImageMetadata-114273561 None] Deleted volume successfully. Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9f8fbf5a-3a04-4451-8190-2d15f2b4e60e tempest-VolumesImageMetadata-114273561 None] Lock "cinder-04740454-152a-4921-b011-4e48999c64ed-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:38 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e" returned: 0 in 0.359s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:38 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72e15b47-6e6e-4664-87cb-6c4332e368b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6fa8772-b652-418d-860c-aceebf65e38e', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f0aa63a-7d0d-4d71-affd-698398d2e867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:39 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Volume volume-a6fa8772-b652-418d-860c-aceebf65e38e (a6fa8772-b652-418d-860c-aceebf65e38e): created successfully Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f0aa63a-7d0d-4d71-affd-698398d2e867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Flow 'volume_create_manager' (cd8ce40d-4d80-4d67-a7b7-c13c4cca4c81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Flow 'volume_create_manager' (3d61fb00-25d1-4b0a-b150-83fbb61ec5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5357feb-3631-4aff-b393-07cab40f9fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:39 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-c46a7d43-0ca0-473e-a3d1-ccac6e99316d tempest-CinderUnicodeTest-1206583602 None] Created volume successfully. Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5357feb-3631-4aff-b393-07cab40f9fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-195410383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ee1bfd-21f5-454e-8818-295d8febe6c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d3e1a32675481691986189cbee67e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:39Z,use_quota=True,user_id='3c0f989d7e83477f9d8e50de864a96ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94dfad70-1b5d-419c-985e-62de8e3e1774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94dfad70-1b5d-419c-985e-62de8e3e1774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b66757d-ee65-4f81-bda1-6dcfaccf3345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b66757d-ee65-4f81-bda1-6dcfaccf3345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63ee1bfd-21f5-454e-8818-295d8febe6c6', 'volume_name': 'volume-63ee1bfd-21f5-454e-8818-295d8febe6c6', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ab4d5e-3fbb-4af9-8092-d1fb108f45c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ab4d5e-3fbb-4af9-8092-d1fb108f45c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74237f5d-9296-4e19-8da0-b63bd152a801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:39 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Volume 63ee1bfd-21f5-454e-8818-295d8febe6c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63ee1bfd-21f5-454e-8818-295d8febe6c6', 'volume_size': 1} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-195410383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ee1bfd-21f5-454e-8818-295d8febe6c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d3e1a32675481691986189cbee67e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:39Z,use_quota=True,user_id='3c0f989d7e83477f9d8e50de864a96ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Creating volume 63ee1bfd-21f5-454e-8818-295d8febe6c6 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:15:39 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63ee1bfd-21f5-454e-8818-295d8febe6c6 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:39 devstack sudo[101262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63ee1bfd-21f5-454e-8818-295d8febe6c6 1073741824 Sep 06 08:15:39 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:39 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63ee1bfd-21f5-454e-8818-295d8febe6c6 1073741824" returned: 0 in 0.452s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63ee1bfd-21f5-454e-8818-295d8febe6c6 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:39 devstack sudo[101268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63ee1bfd-21f5-454e-8818-295d8febe6c6 Sep 06 08:15:39 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:39 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63ee1bfd-21f5-454e-8818-295d8febe6c6" returned: 0 in 0.247s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74237f5d-9296-4e19-8da0-b63bd152a801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63ee1bfd-21f5-454e-8818-295d8febe6c6', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3128a5e0-9f22-4805-9d18-047245018cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:39 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Volume volume-63ee1bfd-21f5-454e-8818-295d8febe6c6 (63ee1bfd-21f5-454e-8818-295d8febe6c6): created successfully Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3128a5e0-9f22-4805-9d18-047245018cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Flow 'volume_create_manager' (3d61fb00-25d1-4b0a-b150-83fbb61ec5d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:39 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-555e6a81-f16e-4889-afb3-aec55bf1cf0e tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Created volume successfully. Sep 06 08:15:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d4577ab5-10bb-4552-ae2f-96c734c7bb17 tempest-CinderUnicodeTest-1206583602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d4577ab5-10bb-4552-ae2f-96c734c7bb17 tempest-CinderUnicodeTest-1206583602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-d4577ab5-10bb-4552-ae2f-96c734c7bb17 tempest-CinderUnicodeTest-1206583602 None] Creating offline snapshot 81c5c20b-4689-42fc-9466-7c4760552a30 of volume a6fa8772-b652-418d-860c-aceebf65e38e {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:15:40 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86e445e-f9b7-41c2-b38f-5a682c091f83]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:15:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d4577ab5-10bb-4552-ae2f-96c734c7bb17 tempest-CinderUnicodeTest-1206583602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:40 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e Sep 06 08:15:40 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:40 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d4577ab5-10bb-4552-ae2f-96c734c7bb17 tempest-CinderUnicodeTest-1206583602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e" returned: 0 in 0.373s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d4577ab5-10bb-4552-ae2f-96c734c7bb17 tempest-CinderUnicodeTest-1206583602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.81c5c20b-4689-42fc-9466-7c4760552a30 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:40 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.81c5c20b-4689-42fc-9466-7c4760552a30 1G Sep 06 08:15:40 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:41 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d4577ab5-10bb-4552-ae2f-96c734c7bb17 tempest-CinderUnicodeTest-1206583602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.81c5c20b-4689-42fc-9466-7c4760552a30 1G" returned: 0 in 0.501s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d4577ab5-10bb-4552-ae2f-96c734c7bb17 tempest-CinderUnicodeTest-1206583602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6fa8772-b652-418d-860c-aceebf65e38e -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.81c5c20b-4689-42fc-9466-7c4760552a30 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:41 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6fa8772-b652-418d-860c-aceebf65e38e -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.81c5c20b-4689-42fc-9466-7c4760552a30 Sep 06 08:15:41 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:41 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d4577ab5-10bb-4552-ae2f-96c734c7bb17 tempest-CinderUnicodeTest-1206583602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6fa8772-b652-418d-860c-aceebf65e38e -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.81c5c20b-4689-42fc-9466-7c4760552a30" returned: 0 in 0.361s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:41 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-d4577ab5-10bb-4552-ae2f-96c734c7bb17 tempest-CinderUnicodeTest-1206583602 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.81c5c20b-4689-42fc-9466-7c4760552a30 is being set with open permissions: ugo+rw Sep 06 08:15:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d4577ab5-10bb-4552-ae2f-96c734c7bb17 tempest-CinderUnicodeTest-1206583602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.81c5c20b-4689-42fc-9466-7c4760552a30 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:41 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.81c5c20b-4689-42fc-9466-7c4760552a30 Sep 06 08:15:41 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:41 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d4577ab5-10bb-4552-ae2f-96c734c7bb17 tempest-CinderUnicodeTest-1206583602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.81c5c20b-4689-42fc-9466-7c4760552a30" returned: 0 in 0.313s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d4577ab5-10bb-4552-ae2f-96c734c7bb17 tempest-CinderUnicodeTest-1206583602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:41 devstack sudo[101302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.info Sep 06 08:15:41 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-ee5b5dbc-3434-4339-aa0d-8da9074cd489 req-a31792f9-1c57-4b74-b3dd-13e0b4542572 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:42 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d4577ab5-10bb-4552-ae2f-96c734c7bb17 tempest-CinderUnicodeTest-1206583602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.info" returned: 0 in 0.256s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:42 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-d4577ab5-10bb-4552-ae2f-96c734c7bb17 tempest-CinderUnicodeTest-1206583602 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.info is being set with open permissions: ugo+rw Sep 06 08:15:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d4577ab5-10bb-4552-ae2f-96c734c7bb17 tempest-CinderUnicodeTest-1206583602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:42 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.info Sep 06 08:15:42 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:42 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d4577ab5-10bb-4552-ae2f-96c734c7bb17 tempest-CinderUnicodeTest-1206583602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.info" returned: 0 in 0.260s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d4577ab5-10bb-4552-ae2f-96c734c7bb17 tempest-CinderUnicodeTest-1206583602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.161s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-ee5b5dbc-3434-4339-aa0d-8da9074cd489 req-a31792f9-1c57-4b74-b3dd-13e0b4542572 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.483s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-ee5b5dbc-3434-4339-aa0d-8da9074cd489 req-a31792f9-1c57-4b74-b3dd-13e0b4542572 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:42 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-d4577ab5-10bb-4552-ae2f-96c734c7bb17 tempest-CinderUnicodeTest-1206583602 None] Create snapshot completed successfully Sep 06 08:15:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-ee5b5dbc-3434-4339-aa0d-8da9074cd489 req-a31792f9-1c57-4b74-b3dd-13e0b4542572 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0', 'name': 'volume-63ee1bfd-21f5-454e-8818-295d8febe6c6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b12a2d52-90b0-4dc0-9ee5-1324f19a6828', 'enforce_multipath': True} {{(pid=87307) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 08:15:42 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-ee5b5dbc-3434-4339-aa0d-8da9074cd489 req-a31792f9-1c57-4b74-b3dd-13e0b4542572 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] attachment_update completed successfully. Sep 06 08:15:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-52677948-340a-46bc-9f36-1c7d8d382095 tempest-CinderUnicodeTest-1206583602 None] Acquiring lock "cinder-81c5c20b-4689-42fc-9466-7c4760552a30-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-52677948-340a-46bc-9f36-1c7d8d382095 tempest-CinderUnicodeTest-1206583602 None] Lock "cinder-81c5c20b-4689-42fc-9466-7c4760552a30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-52677948-340a-46bc-9f36-1c7d8d382095 tempest-CinderUnicodeTest-1206583602 None] Acquiring lock "cinder-quobyte-a6fa8772-b652-418d-860c-aceebf65e38e" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-52677948-340a-46bc-9f36-1c7d8d382095 tempest-CinderUnicodeTest-1206583602 None] Lock "cinder-quobyte-a6fa8772-b652-418d-860c-aceebf65e38e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-52677948-340a-46bc-9f36-1c7d8d382095 tempest-CinderUnicodeTest-1206583602 None] Acquiring lock "cinder-quobyte-81c5c20b-4689-42fc-9466-7c4760552a30" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-52677948-340a-46bc-9f36-1c7d8d382095 tempest-CinderUnicodeTest-1206583602 None] Lock "cinder-quobyte-81c5c20b-4689-42fc-9466-7c4760552a30" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:43 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-52677948-340a-46bc-9f36-1c7d8d382095 tempest-CinderUnicodeTest-1206583602 None] Deleting offline snapshot 81c5c20b-4689-42fc-9466-7c4760552a30 of volume a6fa8772-b652-418d-860c-aceebf65e38e {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:15:43 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-52677948-340a-46bc-9f36-1c7d8d382095 tempest-CinderUnicodeTest-1206583602 None] snapshot_file for this snap is: volume-a6fa8772-b652-418d-860c-aceebf65e38e.81c5c20b-4689-42fc-9466-7c4760552a30 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:15:43 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99d480d-7011-40e1-b057-03af51d13cce]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:15:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-52677948-340a-46bc-9f36-1c7d8d382095 tempest-CinderUnicodeTest-1206583602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.81c5c20b-4689-42fc-9466-7c4760552a30 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:43 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.81c5c20b-4689-42fc-9466-7c4760552a30 Sep 06 08:15:43 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:44 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-52677948-340a-46bc-9f36-1c7d8d382095 tempest-CinderUnicodeTest-1206583602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.81c5c20b-4689-42fc-9466-7c4760552a30" returned: 0 in 0.430s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-52677948-340a-46bc-9f36-1c7d8d382095 tempest-CinderUnicodeTest-1206583602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6fa8772-b652-418d-860c-aceebf65e38e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac49c96-d051-4f50-8fe5-5a8a7e2bf9ea]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-52677948-340a-46bc-9f36-1c7d8d382095 tempest-CinderUnicodeTest-1206583602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Flow 'volume_create_manager' (16b4a4e6-601e-4363-a7ff-00f7144a57c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad503370-e900-4d09-84d4-952a75a424ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad503370-e900-4d09-84d4-952a75a424ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-687810893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e71f5d-a58b-4ae3-acb3-c16c9377995f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8fa78675d94b38bce488eac499083b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:44Z,use_quota=True,user_id='a7c78ea34e004109b67639db0863dea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:44 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e Sep 06 08:15:44 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (739aa6dc-8026-486c-8506-ac173177e485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (739aa6dc-8026-486c-8506-ac173177e485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1e2bc4-d667-4055-86bc-77658d0043c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1e2bc4-d667-4055-86bc-77658d0043c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8e71f5d-a58b-4ae3-acb3-c16c9377995f', 'volume_name': 'volume-a8e71f5d-a58b-4ae3-acb3-c16c9377995f', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cceec121-988f-4965-a5e3-bb2be5f2456f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cceec121-988f-4965-a5e3-bb2be5f2456f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73599445-774f-49f7-b835-6b53dc24361e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:44 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Volume a8e71f5d-a58b-4ae3-acb3-c16c9377995f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8e71f5d-a58b-4ae3-acb3-c16c9377995f', 'volume_size': 1} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-687810893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e71f5d-a58b-4ae3-acb3-c16c9377995f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8fa78675d94b38bce488eac499083b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:44Z,use_quota=True,user_id='a7c78ea34e004109b67639db0863dea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Creating volume a8e71f5d-a58b-4ae3-acb3-c16c9377995f {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:15:44 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a8e71f5d-a58b-4ae3-acb3-c16c9377995f 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:44 devstack sudo[101697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a8e71f5d-a58b-4ae3-acb3-c16c9377995f 1073741824 Sep 06 08:15:44 devstack sudo[101697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:44 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-52677948-340a-46bc-9f36-1c7d8d382095 tempest-CinderUnicodeTest-1206583602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e" returned: 0 in 0.395s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-52677948-340a-46bc-9f36-1c7d8d382095 tempest-CinderUnicodeTest-1206583602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.81c5c20b-4689-42fc-9466-7c4760552a30 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:44 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.81c5c20b-4689-42fc-9466-7c4760552a30 Sep 06 08:15:44 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:44 devstack sudo[101697]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a8e71f5d-a58b-4ae3-acb3-c16c9377995f 1073741824" returned: 0 in 0.488s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a8e71f5d-a58b-4ae3-acb3-c16c9377995f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:44 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a8e71f5d-a58b-4ae3-acb3-c16c9377995f Sep 06 08:15:44 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:44 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-52677948-340a-46bc-9f36-1c7d8d382095 tempest-CinderUnicodeTest-1206583602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.81c5c20b-4689-42fc-9466-7c4760552a30" returned: 0 in 0.390s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-52677948-340a-46bc-9f36-1c7d8d382095 tempest-CinderUnicodeTest-1206583602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.81c5c20b-4689-42fc-9466-7c4760552a30 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:44 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.81c5c20b-4689-42fc-9466-7c4760552a30 Sep 06 08:15:44 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:45 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a8e71f5d-a58b-4ae3-acb3-c16c9377995f" returned: 0 in 0.280s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:15:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73599445-774f-49f7-b835-6b53dc24361e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e71f5d-a58b-4ae3-acb3-c16c9377995f', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b068e22b-4fd6-43e7-a9e5-93773a29ca45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:45 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Volume volume-a8e71f5d-a58b-4ae3-acb3-c16c9377995f (a8e71f5d-a58b-4ae3-acb3-c16c9377995f): created successfully Sep 06 08:15:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b068e22b-4fd6-43e7-a9e5-93773a29ca45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Flow 'volume_create_manager' (16b4a4e6-601e-4363-a7ff-00f7144a57c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:45 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-52677948-340a-46bc-9f36-1c7d8d382095 tempest-CinderUnicodeTest-1206583602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e.81c5c20b-4689-42fc-9466-7c4760552a30" returned: 0 in 0.261s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:45 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-7f899c48-f495-42ae-9799-65c9c1783dd8 tempest-VolumesTransfersV355Test-20643250 None] Created volume successfully. Sep 06 08:15:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-52677948-340a-46bc-9f36-1c7d8d382095 tempest-CinderUnicodeTest-1206583602 None] Lock "cinder-quobyte-81c5c20b-4689-42fc-9466-7c4760552a30" released by "_delete_snapshot" :: held 1.604s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-52677948-340a-46bc-9f36-1c7d8d382095 tempest-CinderUnicodeTest-1206583602 None] Lock "cinder-quobyte-a6fa8772-b652-418d-860c-aceebf65e38e" released by "delete_snapshot" :: held 1.630s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:45 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-52677948-340a-46bc-9f36-1c7d8d382095 tempest-CinderUnicodeTest-1206583602 None] Created reservations ['6e7da670-fd13-4c00-b286-517e3d20a013', 'c453eb23-6da1-4536-8b6a-daa4d5c2ce4f', 'e6a3cdb1-57a2-4b81-a101-e04f0702404d', '4277d52f-6bf5-440c-ba1e-df6b21161fe8'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:15:45 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-52677948-340a-46bc-9f36-1c7d8d382095 tempest-CinderUnicodeTest-1206583602 None] Delete snapshot completed successfully. Sep 06 08:15:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-52677948-340a-46bc-9f36-1c7d8d382095 tempest-CinderUnicodeTest-1206583602 None] Lock "cinder-81c5c20b-4689-42fc-9466-7c4760552a30-delete_snapshot" released by "delete_snapshot" :: held 1.782s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:45 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-fad25dbb-4461-4517-b49f-e830759f99e3 req-dacc2af6-195f-4e23-af98-cffd49b86509 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Terminate volume connection completed successfully. Sep 06 08:15:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-fad25dbb-4461-4517-b49f-e830759f99e3 req-dacc2af6-195f-4e23-af98-cffd49b86509 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Deleting attachment b12a2d52-90b0-4dc0-9ee5-1324f19a6828. {{(pid=87307) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 08:15:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1d26081f-9d32-4b1c-952c-055a80761af2 tempest-CinderUnicodeTest-1206583602 None] Acquiring lock "cinder-a6fa8772-b652-418d-860c-aceebf65e38e-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1d26081f-9d32-4b1c-952c-055a80761af2 tempest-CinderUnicodeTest-1206583602 None] Lock "cinder-a6fa8772-b652-418d-860c-aceebf65e38e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1d26081f-9d32-4b1c-952c-055a80761af2 tempest-CinderUnicodeTest-1206583602 None] Acquiring lock "cinder-quobyte-a6fa8772-b652-418d-860c-aceebf65e38e" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1d26081f-9d32-4b1c-952c-055a80761af2 tempest-CinderUnicodeTest-1206583602 None] Lock "cinder-quobyte-a6fa8772-b652-418d-860c-aceebf65e38e" acquired by "delete_volume" :: waited 0.016s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:45 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa278e1-af91-478d-91d0-fb1b322b546d]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:15:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1d26081f-9d32-4b1c-952c-055a80761af2 tempest-CinderUnicodeTest-1206583602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:45 devstack sudo[101743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e Sep 06 08:15:45 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:46 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1d26081f-9d32-4b1c-952c-055a80761af2 tempest-CinderUnicodeTest-1206583602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e" returned: 0 in 0.370s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1d26081f-9d32-4b1c-952c-055a80761af2 tempest-CinderUnicodeTest-1206583602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:46 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e Sep 06 08:15:46 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:46 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1d26081f-9d32-4b1c-952c-055a80761af2 tempest-CinderUnicodeTest-1206583602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a6fa8772-b652-418d-860c-aceebf65e38e" returned: 0 in 0.267s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:46 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1d26081f-9d32-4b1c-952c-055a80761af2 tempest-CinderUnicodeTest-1206583602 None] Lock "cinder-quobyte-a6fa8772-b652-418d-860c-aceebf65e38e" released by "delete_volume" :: held 0.707s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:46 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-aae17f57-3e06-4c3d-9210-ff12dde917f7 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Acquiring lock "cinder-63ee1bfd-21f5-454e-8818-295d8febe6c6-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:46 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-aae17f57-3e06-4c3d-9210-ff12dde917f7 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Lock "cinder-63ee1bfd-21f5-454e-8818-295d8febe6c6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:46 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-1d26081f-9d32-4b1c-952c-055a80761af2 tempest-CinderUnicodeTest-1206583602 None] Created reservations ['8deff0f6-4a43-4f86-8dfd-c903b5ddd6f1', '5990e936-056a-4f6d-a7a9-e92b957c97dd', 'a10fd628-cc74-4f84-89a1-0ddc45b5338a', '0fd7289a-ce8e-459f-9d1f-7371a07c4d3d'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:15:46 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-aae17f57-3e06-4c3d-9210-ff12dde917f7 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Acquiring lock "cinder-quobyte-63ee1bfd-21f5-454e-8818-295d8febe6c6" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:46 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-aae17f57-3e06-4c3d-9210-ff12dde917f7 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Lock "cinder-quobyte-63ee1bfd-21f5-454e-8818-295d8febe6c6" acquired by "delete_volume" :: waited 0.022s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:46 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dede99-a3b4-44f1-abcf-929a29af72b1]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:15:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-aae17f57-3e06-4c3d-9210-ff12dde917f7 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63ee1bfd-21f5-454e-8818-295d8febe6c6 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1d26081f-9d32-4b1c-952c-055a80761af2 tempest-CinderUnicodeTest-1206583602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1d26081f-9d32-4b1c-952c-055a80761af2 tempest-CinderUnicodeTest-1206583602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1d26081f-9d32-4b1c-952c-055a80761af2 tempest-CinderUnicodeTest-1206583602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1d26081f-9d32-4b1c-952c-055a80761af2 tempest-CinderUnicodeTest-1206583602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1d26081f-9d32-4b1c-952c-055a80761af2 tempest-CinderUnicodeTest-1206583602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1d26081f-9d32-4b1c-952c-055a80761af2 tempest-CinderUnicodeTest-1206583602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:46 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:15:46 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:46 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63ee1bfd-21f5-454e-8818-295d8febe6c6 Sep 06 08:15:46 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:46 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-640ae33c-6e30-4b03-a5b3-5a56360a09a4 tempest-CinderUnicodeTest-1206583602 None] Acquiring lock "cinder-09353545-8ec5-43fd-ac35-ac7a0857a548-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:46 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-640ae33c-6e30-4b03-a5b3-5a56360a09a4 tempest-CinderUnicodeTest-1206583602 None] Lock "cinder-09353545-8ec5-43fd-ac35-ac7a0857a548-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:46 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-5d0cc4bc-3e82-44ad-8064-a011336e167b tempest-VolumesTransfersV355Test-1772831449 None] Transfer volume completed successfully. Sep 06 08:15:46 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1d26081f-9d32-4b1c-952c-055a80761af2 tempest-CinderUnicodeTest-1206583602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.310s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:46 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-1d26081f-9d32-4b1c-952c-055a80761af2 tempest-CinderUnicodeTest-1206583602 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:15:46 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-1d26081f-9d32-4b1c-952c-055a80761af2 tempest-CinderUnicodeTest-1206583602 None] Deleted volume successfully. Sep 06 08:15:46 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-640ae33c-6e30-4b03-a5b3-5a56360a09a4 tempest-CinderUnicodeTest-1206583602 None] Acquiring lock "cinder-quobyte-09353545-8ec5-43fd-ac35-ac7a0857a548" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:46 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1d26081f-9d32-4b1c-952c-055a80761af2 tempest-CinderUnicodeTest-1206583602 None] Lock "cinder-a6fa8772-b652-418d-860c-aceebf65e38e-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:46 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-640ae33c-6e30-4b03-a5b3-5a56360a09a4 tempest-CinderUnicodeTest-1206583602 None] Lock "cinder-quobyte-09353545-8ec5-43fd-ac35-ac7a0857a548" acquired by "delete_volume" :: waited 0.028s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9ad6f9-9582-4d7a-824e-be34327fce37]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-640ae33c-6e30-4b03-a5b3-5a56360a09a4 tempest-CinderUnicodeTest-1206583602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-09353545-8ec5-43fd-ac35-ac7a0857a548 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:47 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-aae17f57-3e06-4c3d-9210-ff12dde917f7 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63ee1bfd-21f5-454e-8818-295d8febe6c6" returned: 0 in 0.496s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-aae17f57-3e06-4c3d-9210-ff12dde917f7 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63ee1bfd-21f5-454e-8818-295d8febe6c6 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:47 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63ee1bfd-21f5-454e-8818-295d8febe6c6 Sep 06 08:15:47 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:47 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-09353545-8ec5-43fd-ac35-ac7a0857a548 Sep 06 08:15:47 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:47 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-aae17f57-3e06-4c3d-9210-ff12dde917f7 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-63ee1bfd-21f5-454e-8818-295d8febe6c6" returned: 0 in 0.275s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-aae17f57-3e06-4c3d-9210-ff12dde917f7 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Lock "cinder-quobyte-63ee1bfd-21f5-454e-8818-295d8febe6c6" released by "delete_volume" :: held 0.818s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-aae17f57-3e06-4c3d-9210-ff12dde917f7 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Created reservations ['094e7bd7-ad52-4c4f-b1f0-4f0f72786c34', '1d1ece49-67e0-46ce-ac7f-21f9ac4b1e74', '49db29c5-8001-4ba4-83e2-f5fd233f92b9', '09f9b78f-4c06-4e68-9da3-48f2beae57b6'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:15:47 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-640ae33c-6e30-4b03-a5b3-5a56360a09a4 tempest-CinderUnicodeTest-1206583602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-09353545-8ec5-43fd-ac35-ac7a0857a548" returned: 0 in 0.426s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-640ae33c-6e30-4b03-a5b3-5a56360a09a4 tempest-CinderUnicodeTest-1206583602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-09353545-8ec5-43fd-ac35-ac7a0857a548 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:47 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-09353545-8ec5-43fd-ac35-ac7a0857a548 Sep 06 08:15:47 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-aae17f57-3e06-4c3d-9210-ff12dde917f7 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-aae17f57-3e06-4c3d-9210-ff12dde917f7 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-aae17f57-3e06-4c3d-9210-ff12dde917f7 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-aae17f57-3e06-4c3d-9210-ff12dde917f7 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-aae17f57-3e06-4c3d-9210-ff12dde917f7 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-aae17f57-3e06-4c3d-9210-ff12dde917f7 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:47 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:15:47 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f9bd1a71-57ad-4d0d-9328-e3bba76ea9dd tempest-VolumesTransfersV355Test-654862308 None] Acquiring lock "cinder-a8e71f5d-a58b-4ae3-acb3-c16c9377995f-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f9bd1a71-57ad-4d0d-9328-e3bba76ea9dd tempest-VolumesTransfersV355Test-654862308 None] Lock "cinder-a8e71f5d-a58b-4ae3-acb3-c16c9377995f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f9bd1a71-57ad-4d0d-9328-e3bba76ea9dd tempest-VolumesTransfersV355Test-654862308 None] Acquiring lock "cinder-quobyte-a8e71f5d-a58b-4ae3-acb3-c16c9377995f" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f9bd1a71-57ad-4d0d-9328-e3bba76ea9dd tempest-VolumesTransfersV355Test-654862308 None] Lock "cinder-quobyte-a8e71f5d-a58b-4ae3-acb3-c16c9377995f" acquired by "delete_volume" :: waited 0.019s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[18121600-1a1f-4a26-be44-ef93172fb88b]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f9bd1a71-57ad-4d0d-9328-e3bba76ea9dd tempest-VolumesTransfersV355Test-654862308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a8e71f5d-a58b-4ae3-acb3-c16c9377995f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:47 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-640ae33c-6e30-4b03-a5b3-5a56360a09a4 tempest-CinderUnicodeTest-1206583602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-09353545-8ec5-43fd-ac35-ac7a0857a548" returned: 0 in 0.336s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-640ae33c-6e30-4b03-a5b3-5a56360a09a4 tempest-CinderUnicodeTest-1206583602 None] Lock "cinder-quobyte-09353545-8ec5-43fd-ac35-ac7a0857a548" released by "delete_volume" :: held 0.826s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:47 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a8e71f5d-a58b-4ae3-acb3-c16c9377995f Sep 06 08:15:47 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-640ae33c-6e30-4b03-a5b3-5a56360a09a4 tempest-CinderUnicodeTest-1206583602 None] Created reservations ['9a55a358-7df1-4848-b08e-0a31074d96f6', '54303e00-22ac-49cc-8ea9-cfcee7437596', '8554eee7-3726-4fbc-ac5d-1ea7441d9cf7', 'cdf3086e-8e1e-421e-ab93-f1a2f236bab1'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:15:47 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-aae17f57-3e06-4c3d-9210-ff12dde917f7 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.390s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-aae17f57-3e06-4c3d-9210-ff12dde917f7 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:15:47 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-aae17f57-3e06-4c3d-9210-ff12dde917f7 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Deleted volume successfully. Sep 06 08:15:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-aae17f57-3e06-4c3d-9210-ff12dde917f7 tempest-TestServerVolumeAttachScenarioOldVersion-306819838 None] Lock "cinder-63ee1bfd-21f5-454e-8818-295d8febe6c6-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-640ae33c-6e30-4b03-a5b3-5a56360a09a4 tempest-CinderUnicodeTest-1206583602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-640ae33c-6e30-4b03-a5b3-5a56360a09a4 tempest-CinderUnicodeTest-1206583602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:48 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-640ae33c-6e30-4b03-a5b3-5a56360a09a4 tempest-CinderUnicodeTest-1206583602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:48 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-640ae33c-6e30-4b03-a5b3-5a56360a09a4 tempest-CinderUnicodeTest-1206583602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-640ae33c-6e30-4b03-a5b3-5a56360a09a4 tempest-CinderUnicodeTest-1206583602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-640ae33c-6e30-4b03-a5b3-5a56360a09a4 tempest-CinderUnicodeTest-1206583602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:48 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:15:48 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:48 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f9bd1a71-57ad-4d0d-9328-e3bba76ea9dd tempest-VolumesTransfersV355Test-654862308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a8e71f5d-a58b-4ae3-acb3-c16c9377995f" returned: 0 in 0.703s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f9bd1a71-57ad-4d0d-9328-e3bba76ea9dd tempest-VolumesTransfersV355Test-654862308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a8e71f5d-a58b-4ae3-acb3-c16c9377995f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:48 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-640ae33c-6e30-4b03-a5b3-5a56360a09a4 tempest-CinderUnicodeTest-1206583602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.427s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:48 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-640ae33c-6e30-4b03-a5b3-5a56360a09a4 tempest-CinderUnicodeTest-1206583602 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:15:48 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a8e71f5d-a58b-4ae3-acb3-c16c9377995f Sep 06 08:15:48 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-640ae33c-6e30-4b03-a5b3-5a56360a09a4 tempest-CinderUnicodeTest-1206583602 None] Deleted volume successfully. Sep 06 08:15:48 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:48 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-640ae33c-6e30-4b03-a5b3-5a56360a09a4 tempest-CinderUnicodeTest-1206583602 None] Lock "cinder-09353545-8ec5-43fd-ac35-ac7a0857a548-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:48 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f9bd1a71-57ad-4d0d-9328-e3bba76ea9dd tempest-VolumesTransfersV355Test-654862308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a8e71f5d-a58b-4ae3-acb3-c16c9377995f" returned: 0 in 0.289s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:48 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f9bd1a71-57ad-4d0d-9328-e3bba76ea9dd tempest-VolumesTransfersV355Test-654862308 None] Lock "cinder-quobyte-a8e71f5d-a58b-4ae3-acb3-c16c9377995f" released by "delete_volume" :: held 1.055s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:48 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-f9bd1a71-57ad-4d0d-9328-e3bba76ea9dd tempest-VolumesTransfersV355Test-654862308 None] Created reservations ['6c5c87ce-28bf-45db-b95b-eea362ab1e1b', 'a0802f29-4446-494f-be62-39c7e7706943', '245bdd52-7d65-408d-bd15-9d782f75b92a', 'f87cb004-16f0-4ccf-93d2-d71e29de4334'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:15:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f9bd1a71-57ad-4d0d-9328-e3bba76ea9dd tempest-VolumesTransfersV355Test-654862308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f9bd1a71-57ad-4d0d-9328-e3bba76ea9dd tempest-VolumesTransfersV355Test-654862308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:48 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f9bd1a71-57ad-4d0d-9328-e3bba76ea9dd tempest-VolumesTransfersV355Test-654862308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:48 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f9bd1a71-57ad-4d0d-9328-e3bba76ea9dd tempest-VolumesTransfersV355Test-654862308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f9bd1a71-57ad-4d0d-9328-e3bba76ea9dd tempest-VolumesTransfersV355Test-654862308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f9bd1a71-57ad-4d0d-9328-e3bba76ea9dd tempest-VolumesTransfersV355Test-654862308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:48 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:15:48 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:49 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f9bd1a71-57ad-4d0d-9328-e3bba76ea9dd tempest-VolumesTransfersV355Test-654862308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.303s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:49 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-f9bd1a71-57ad-4d0d-9328-e3bba76ea9dd tempest-VolumesTransfersV355Test-654862308 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:15:49 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f9bd1a71-57ad-4d0d-9328-e3bba76ea9dd tempest-VolumesTransfersV355Test-654862308 None] Deleted volume successfully. Sep 06 08:15:49 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f9bd1a71-57ad-4d0d-9328-e3bba76ea9dd tempest-VolumesTransfersV355Test-654862308 None] Lock "cinder-a8e71f5d-a58b-4ae3-acb3-c16c9377995f-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:50 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:15:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Flow 'volume_create_manager' (655d3e0c-4e3b-460f-99a3-ba4ccc4b4b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7592fea6-9262-43c8-a2ab-cb5261edaaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7592fea6-9262-43c8-a2ab-cb5261edaaef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2043570247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9de134-a7ea-4f53-9f4b-311d95aa7476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8fa78675d94b38bce488eac499083b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:50Z,use_quota=True,user_id='a7c78ea34e004109b67639db0863dea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ab839b-0999-4248-86c7-b1106443b74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ab839b-0999-4248-86c7-b1106443b74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba5e58df-6167-487f-9f4f-76d2c65a2697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba5e58df-6167-487f-9f4f-76d2c65a2697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df9de134-a7ea-4f53-9f4b-311d95aa7476', 'volume_name': 'volume-df9de134-a7ea-4f53-9f4b-311d95aa7476', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a939ff00-b3db-4f34-b952-755e759b1035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a939ff00-b3db-4f34-b952-755e759b1035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b57223-3a99-4573-8667-6315c2dd1fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:50 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Volume df9de134-a7ea-4f53-9f4b-311d95aa7476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df9de134-a7ea-4f53-9f4b-311d95aa7476', 'volume_size': 1} Sep 06 08:15:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:50 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2043570247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9de134-a7ea-4f53-9f4b-311d95aa7476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8fa78675d94b38bce488eac499083b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:50Z,use_quota=True,user_id='a7c78ea34e004109b67639db0863dea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:15:50 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Creating volume df9de134-a7ea-4f53-9f4b-311d95aa7476 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:15:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:50 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:50 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:50 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:15:50 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:15:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df9de134-a7ea-4f53-9f4b-311d95aa7476 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:50 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df9de134-a7ea-4f53-9f4b-311d95aa7476 1073741824 Sep 06 08:15:50 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:51 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df9de134-a7ea-4f53-9f4b-311d95aa7476 1073741824" returned: 0 in 0.583s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df9de134-a7ea-4f53-9f4b-311d95aa7476 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:51 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df9de134-a7ea-4f53-9f4b-311d95aa7476 Sep 06 08:15:51 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:51 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df9de134-a7ea-4f53-9f4b-311d95aa7476" returned: 0 in 0.298s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:15:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b57223-3a99-4573-8667-6315c2dd1fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df9de134-a7ea-4f53-9f4b-311d95aa7476', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576c01b4-ff1a-40e0-a28e-0dfaeac178f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:51 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Volume volume-df9de134-a7ea-4f53-9f4b-311d95aa7476 (df9de134-a7ea-4f53-9f4b-311d95aa7476): created successfully Sep 06 08:15:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576c01b4-ff1a-40e0-a28e-0dfaeac178f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Flow 'volume_create_manager' (655d3e0c-4e3b-460f-99a3-ba4ccc4b4b59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:51 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-bc7cd7a7-a778-44ba-9bfb-3b5495b56581 tempest-VolumesTransfersV355Test-20643250 None] Created volume successfully. Sep 06 08:15:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ce27b993-6231-4302-9a2e-baf4b56ffee8 tempest-VolumesTransfersV355Test-654862308 None] Acquiring lock "cinder-df9de134-a7ea-4f53-9f4b-311d95aa7476-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ce27b993-6231-4302-9a2e-baf4b56ffee8 tempest-VolumesTransfersV355Test-654862308 None] Lock "cinder-df9de134-a7ea-4f53-9f4b-311d95aa7476-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ce27b993-6231-4302-9a2e-baf4b56ffee8 tempest-VolumesTransfersV355Test-654862308 None] Acquiring lock "cinder-quobyte-df9de134-a7ea-4f53-9f4b-311d95aa7476" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ce27b993-6231-4302-9a2e-baf4b56ffee8 tempest-VolumesTransfersV355Test-654862308 None] Lock "cinder-quobyte-df9de134-a7ea-4f53-9f4b-311d95aa7476" acquired by "delete_volume" :: waited 0.023s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40a20dd-05b1-4d89-a1bc-d4321750b9b8]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ce27b993-6231-4302-9a2e-baf4b56ffee8 tempest-VolumesTransfersV355Test-654862308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df9de134-a7ea-4f53-9f4b-311d95aa7476 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:53 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df9de134-a7ea-4f53-9f4b-311d95aa7476 Sep 06 08:15:53 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:53 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ce27b993-6231-4302-9a2e-baf4b56ffee8 tempest-VolumesTransfersV355Test-654862308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df9de134-a7ea-4f53-9f4b-311d95aa7476" returned: 0 in 0.427s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ce27b993-6231-4302-9a2e-baf4b56ffee8 tempest-VolumesTransfersV355Test-654862308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df9de134-a7ea-4f53-9f4b-311d95aa7476 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:15:53 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df9de134-a7ea-4f53-9f4b-311d95aa7476 Sep 06 08:15:53 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Flow 'volume_create_manager' (4939c1e6-2731-4c9f-b09e-a2c1efa567aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161c7ff4-6c5a-46ff-b6d7-75bdc715fb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161c7ff4-6c5a-46ff-b6d7-75bdc715fb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1234680355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ac028f6be247ea98de319a57926560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:53Z,use_quota=True,user_id='2cd32c22c76e4629b95ecf72b0de9962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05c684d5-18f8-4fa7-b60b-69873817783e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05c684d5-18f8-4fa7-b60b-69873817783e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba57e15-dc41-47ad-85b7-8ba95bc8154f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba57e15-dc41-47ad-85b7-8ba95bc8154f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20', 'volume_name': 'volume-4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd7f0489-21c0-4b70-b2d8-5655e9340b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd7f0489-21c0-4b70-b2d8-5655e9340b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf319fae-4657-4efd-9aca-b3e746c162d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:53 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Volume 4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20', 'volume_size': 1} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1234680355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ac028f6be247ea98de319a57926560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:53Z,use_quota=True,user_id='2cd32c22c76e4629b95ecf72b0de9962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Creating volume 4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:15:53 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:53 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20 1073741824 Sep 06 08:15:53 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:53 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ce27b993-6231-4302-9a2e-baf4b56ffee8 tempest-VolumesTransfersV355Test-654862308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df9de134-a7ea-4f53-9f4b-311d95aa7476" returned: 0 in 0.271s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ce27b993-6231-4302-9a2e-baf4b56ffee8 tempest-VolumesTransfersV355Test-654862308 None] Lock "cinder-quobyte-df9de134-a7ea-4f53-9f4b-311d95aa7476" released by "delete_volume" :: held 0.760s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-ce27b993-6231-4302-9a2e-baf4b56ffee8 tempest-VolumesTransfersV355Test-654862308 None] Created reservations ['ddebdc5f-f82d-452c-b52b-b89f32d52795', '1166479c-048d-4b13-a1f5-8ee5835b5d8c', '9b395c94-308a-4883-9f90-5f02dab5210d', '02093a83-65a3-488f-93ba-8d6a268b87af'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ce27b993-6231-4302-9a2e-baf4b56ffee8 tempest-VolumesTransfersV355Test-654862308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ce27b993-6231-4302-9a2e-baf4b56ffee8 tempest-VolumesTransfersV355Test-654862308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ce27b993-6231-4302-9a2e-baf4b56ffee8 tempest-VolumesTransfersV355Test-654862308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ce27b993-6231-4302-9a2e-baf4b56ffee8 tempest-VolumesTransfersV355Test-654862308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ce27b993-6231-4302-9a2e-baf4b56ffee8 tempest-VolumesTransfersV355Test-654862308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ce27b993-6231-4302-9a2e-baf4b56ffee8 tempest-VolumesTransfersV355Test-654862308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:53 devstack sudo[101873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:15:53 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:54 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20 1073741824" returned: 0 in 0.523s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:54 devstack sudo[101877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20 Sep 06 08:15:54 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:54 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ce27b993-6231-4302-9a2e-baf4b56ffee8 tempest-VolumesTransfersV355Test-654862308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.319s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:54 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-ce27b993-6231-4302-9a2e-baf4b56ffee8 tempest-VolumesTransfersV355Test-654862308 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:15:54 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-ce27b993-6231-4302-9a2e-baf4b56ffee8 tempest-VolumesTransfersV355Test-654862308 None] Deleted volume successfully. Sep 06 08:15:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ce27b993-6231-4302-9a2e-baf4b56ffee8 tempest-VolumesTransfersV355Test-654862308 None] Lock "cinder-df9de134-a7ea-4f53-9f4b-311d95aa7476-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:54 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20" returned: 0 in 0.338s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:15:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf319fae-4657-4efd-9aca-b3e746c162d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (370740d1-a471-4513-aefb-0346434a5b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:54 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Volume volume-4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20 (4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20): created successfully Sep 06 08:15:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (370740d1-a471-4513-aefb-0346434a5b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Flow 'volume_create_manager' (4939c1e6-2731-4c9f-b09e-a2c1efa567aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:54 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-08040fab-30c4-4e9e-b2ca-cf13bf0538d4 tempest-ProjectReaderTests-718220170 None] Created volume successfully. Sep 06 08:15:55 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-06fe4e25-8b01-4085-81fe-5ad540373ada tempest-ProjectReaderTests-718220170 None] Acquiring lock "cinder-4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:55 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-06fe4e25-8b01-4085-81fe-5ad540373ada tempest-ProjectReaderTests-718220170 None] Lock "cinder-4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:55 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-06fe4e25-8b01-4085-81fe-5ad540373ada tempest-ProjectReaderTests-718220170 None] Acquiring lock "cinder-quobyte-4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:55 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-06fe4e25-8b01-4085-81fe-5ad540373ada tempest-ProjectReaderTests-718220170 None] Lock "cinder-quobyte-4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20" acquired by "delete_volume" :: waited 0.023s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:55 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e618bbfd-b86e-4033-861c-d40ae292592d]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:15:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-06fe4e25-8b01-4085-81fe-5ad540373ada tempest-ProjectReaderTests-718220170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:56 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20 Sep 06 08:15:56 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:56 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-06fe4e25-8b01-4085-81fe-5ad540373ada tempest-ProjectReaderTests-718220170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20" returned: 0 in 0.513s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-06fe4e25-8b01-4085-81fe-5ad540373ada tempest-ProjectReaderTests-718220170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:56 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20 Sep 06 08:15:56 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:56 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-06fe4e25-8b01-4085-81fe-5ad540373ada tempest-ProjectReaderTests-718220170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20" returned: 0 in 0.265s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-06fe4e25-8b01-4085-81fe-5ad540373ada tempest-ProjectReaderTests-718220170 None] Lock "cinder-quobyte-4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20" released by "delete_volume" :: held 0.824s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:56 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-06fe4e25-8b01-4085-81fe-5ad540373ada tempest-ProjectReaderTests-718220170 None] Created reservations ['c2c8a956-1575-4e2b-a8ef-06795957b0d9', 'a1589460-72fb-456b-bb9d-3da3a13a73be', 'ea1952a9-5a81-45ab-8efd-2ef29ea64566', '95e5632b-c917-4ece-9528-952c1b4bafd2'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:15:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-06fe4e25-8b01-4085-81fe-5ad540373ada tempest-ProjectReaderTests-718220170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-06fe4e25-8b01-4085-81fe-5ad540373ada tempest-ProjectReaderTests-718220170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-06fe4e25-8b01-4085-81fe-5ad540373ada tempest-ProjectReaderTests-718220170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-06fe4e25-8b01-4085-81fe-5ad540373ada tempest-ProjectReaderTests-718220170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-06fe4e25-8b01-4085-81fe-5ad540373ada tempest-ProjectReaderTests-718220170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-06fe4e25-8b01-4085-81fe-5ad540373ada tempest-ProjectReaderTests-718220170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:56 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:15:56 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:57 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-06fe4e25-8b01-4085-81fe-5ad540373ada tempest-ProjectReaderTests-718220170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.315s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-06fe4e25-8b01-4085-81fe-5ad540373ada tempest-ProjectReaderTests-718220170 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:15:57 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-06fe4e25-8b01-4085-81fe-5ad540373ada tempest-ProjectReaderTests-718220170 None] Deleted volume successfully. Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-06fe4e25-8b01-4085-81fe-5ad540373ada tempest-ProjectReaderTests-718220170 None] Lock "cinder-4cb5cfe3-fcbd-4c2c-9900-4ee0b3e81e20-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Flow 'volume_create_manager' (b70d04ac-5efa-4af9-a621-490460889a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (430ed0ee-9e21-4ef1-b29c-f60bfe3e529b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (430ed0ee-9e21-4ef1-b29c-f60bfe3e529b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-218786343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f8c380-b8e2-41ed-9214-a0d74706ede0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ac028f6be247ea98de319a57926560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:58Z,use_quota=True,user_id='2cd32c22c76e4629b95ecf72b0de9962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd86e3a-9a2f-406a-b4a1-502c03f06d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd86e3a-9a2f-406a-b4a1-502c03f06d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb76e7f-58a4-41bb-b01b-b0edc8dca3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb76e7f-58a4-41bb-b01b-b0edc8dca3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71f8c380-b8e2-41ed-9214-a0d74706ede0', 'volume_name': 'volume-71f8c380-b8e2-41ed-9214-a0d74706ede0', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70c26938-b07b-4773-b123-3308f2077fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70c26938-b07b-4773-b123-3308f2077fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6a5f40-d566-4cff-82ba-f279e38f2f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:57 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Volume 71f8c380-b8e2-41ed-9214-a0d74706ede0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71f8c380-b8e2-41ed-9214-a0d74706ede0', 'volume_size': 1} Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-218786343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f8c380-b8e2-41ed-9214-a0d74706ede0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ac028f6be247ea98de319a57926560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:15:58Z,use_quota=True,user_id='2cd32c22c76e4629b95ecf72b0de9962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Creating volume 71f8c380-b8e2-41ed-9214-a0d74706ede0 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:15:57 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:15:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-71f8c380-b8e2-41ed-9214-a0d74706ede0 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:57 devstack sudo[101893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-71f8c380-b8e2-41ed-9214-a0d74706ede0 1073741824 Sep 06 08:15:57 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:58 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-71f8c380-b8e2-41ed-9214-a0d74706ede0 1073741824" returned: 0 in 0.539s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-71f8c380-b8e2-41ed-9214-a0d74706ede0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:58 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-71f8c380-b8e2-41ed-9214-a0d74706ede0 Sep 06 08:15:58 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:58 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Sep 06 08:15:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-71f8c380-b8e2-41ed-9214-a0d74706ede0" returned: 0 in 0.302s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:15:58 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:15:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6a5f40-d566-4cff-82ba-f279e38f2f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71f8c380-b8e2-41ed-9214-a0d74706ede0', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e72c2c-eafe-47fe-8a5b-89da2f93d0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:15:58 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Volume volume-71f8c380-b8e2-41ed-9214-a0d74706ede0 (71f8c380-b8e2-41ed-9214-a0d74706ede0): created successfully Sep 06 08:15:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e72c2c-eafe-47fe-8a5b-89da2f93d0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:15:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Flow 'volume_create_manager' (b70d04ac-5efa-4af9-a621-490460889a6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:15:58 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-d4a551fe-962f-442b-8fb8-ae4fabc1502d tempest-ProjectReaderTests-718220170 None] Created volume successfully. Sep 06 08:15:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:15:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:15:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:15:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:15:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:15:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:15:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:15:59 devstack sudo[101903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:15:59 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:15:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-64c4eb22-c98d-4e1c-856c-914d74a6d48a tempest-ProjectReaderTests-718220170 None] Acquiring lock "cinder-71f8c380-b8e2-41ed-9214-a0d74706ede0-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-64c4eb22-c98d-4e1c-856c-914d74a6d48a tempest-ProjectReaderTests-718220170 None] Lock "cinder-71f8c380-b8e2-41ed-9214-a0d74706ede0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:15:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-64c4eb22-c98d-4e1c-856c-914d74a6d48a tempest-ProjectReaderTests-718220170 None] Acquiring lock "cinder-quobyte-71f8c380-b8e2-41ed-9214-a0d74706ede0" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:15:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-64c4eb22-c98d-4e1c-856c-914d74a6d48a tempest-ProjectReaderTests-718220170 None] Lock "cinder-quobyte-71f8c380-b8e2-41ed-9214-a0d74706ede0" acquired by "delete_volume" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:00 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[67931df0-9152-46d9-83d3-38a968dd1acd]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:16:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-64c4eb22-c98d-4e1c-856c-914d74a6d48a tempest-ProjectReaderTests-718220170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-71f8c380-b8e2-41ed-9214-a0d74706ede0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:00 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.374s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:00 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:16:00 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager._thread_info {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:16:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread count: 28 {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 08:16:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread info: [<_MainThread(MainThread, started 139985167040640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:16:00 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-71f8c380-b8e2-41ed-9214-a0d74706ede0 Sep 06 08:16:00 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:00 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-64c4eb22-c98d-4e1c-856c-914d74a6d48a tempest-ProjectReaderTests-718220170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-71f8c380-b8e2-41ed-9214-a0d74706ede0" returned: 0 in 0.403s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-64c4eb22-c98d-4e1c-856c-914d74a6d48a tempest-ProjectReaderTests-718220170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-71f8c380-b8e2-41ed-9214-a0d74706ede0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:00 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-71f8c380-b8e2-41ed-9214-a0d74706ede0 Sep 06 08:16:00 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:00 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-64c4eb22-c98d-4e1c-856c-914d74a6d48a tempest-ProjectReaderTests-718220170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-71f8c380-b8e2-41ed-9214-a0d74706ede0" returned: 0 in 0.282s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-64c4eb22-c98d-4e1c-856c-914d74a6d48a tempest-ProjectReaderTests-718220170 None] Lock "cinder-quobyte-71f8c380-b8e2-41ed-9214-a0d74706ede0" released by "delete_volume" :: held 0.738s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:00 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-64c4eb22-c98d-4e1c-856c-914d74a6d48a tempest-ProjectReaderTests-718220170 None] Created reservations ['e90235f2-0d90-464d-ab22-4fbc10fe257b', 'c995d69c-e18d-4316-a42d-0168d238dbb4', '982b5813-b279-49f7-a3c7-38cab7226c7c', 'ad95a610-9583-4b13-ba45-bbc0d6c7f9e8'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:16:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-64c4eb22-c98d-4e1c-856c-914d74a6d48a tempest-ProjectReaderTests-718220170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-64c4eb22-c98d-4e1c-856c-914d74a6d48a tempest-ProjectReaderTests-718220170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-64c4eb22-c98d-4e1c-856c-914d74a6d48a tempest-ProjectReaderTests-718220170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:16:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-64c4eb22-c98d-4e1c-856c-914d74a6d48a tempest-ProjectReaderTests-718220170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:16:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-64c4eb22-c98d-4e1c-856c-914d74a6d48a tempest-ProjectReaderTests-718220170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-64c4eb22-c98d-4e1c-856c-914d74a6d48a tempest-ProjectReaderTests-718220170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:00 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:16:00 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:01 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-64c4eb22-c98d-4e1c-856c-914d74a6d48a tempest-ProjectReaderTests-718220170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.366s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:01 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-64c4eb22-c98d-4e1c-856c-914d74a6d48a tempest-ProjectReaderTests-718220170 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:16:01 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-64c4eb22-c98d-4e1c-856c-914d74a6d48a tempest-ProjectReaderTests-718220170 None] Deleted volume successfully. Sep 06 08:16:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-64c4eb22-c98d-4e1c-856c-914d74a6d48a tempest-ProjectReaderTests-718220170 None] Lock "cinder-71f8c380-b8e2-41ed-9214-a0d74706ede0-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Flow 'volume_create_manager' (6158fa25-5e84-467e-b32f-74150bb33c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e11d83-4717-4fac-990b-1c4be5c604b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e11d83-4717-4fac-990b-1c4be5c604b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1026189976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eef1c09a-26c8-4a76-9e95-885ed2ef6787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707e478fa5c24fe8bebe1abeed803890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:16:06Z,use_quota=True,user_id='0d48d1dc84cb4421b6553a6b4c1196e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d47f8387-5b28-48ce-a241-045bd21687eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d47f8387-5b28-48ce-a241-045bd21687eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d843f6-3369-4623-8abd-b5499a2cf082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d843f6-3369-4623-8abd-b5499a2cf082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eef1c09a-26c8-4a76-9e95-885ed2ef6787', 'volume_name': 'volume-eef1c09a-26c8-4a76-9e95-885ed2ef6787', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe64e0cd-2f71-40b7-8d1e-010009d3c31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe64e0cd-2f71-40b7-8d1e-010009d3c31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595f56bb-59ac-4a66-a72a-00a99793479f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:06 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Volume eef1c09a-26c8-4a76-9e95-885ed2ef6787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eef1c09a-26c8-4a76-9e95-885ed2ef6787', 'volume_size': 1} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1026189976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eef1c09a-26c8-4a76-9e95-885ed2ef6787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707e478fa5c24fe8bebe1abeed803890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:16:06Z,use_quota=True,user_id='0d48d1dc84cb4421b6553a6b4c1196e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Creating volume eef1c09a-26c8-4a76-9e95-885ed2ef6787 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:16:06 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eef1c09a-26c8-4a76-9e95-885ed2ef6787 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:06 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eef1c09a-26c8-4a76-9e95-885ed2ef6787 1073741824 Sep 06 08:16:06 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Flow 'volume_create_manager' (f17d3032-9cd3-491b-8cba-3da19e45fadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07af4eb-54dd-4434-a168-511f62488ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07af4eb-54dd-4434-a168-511f62488ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-126357676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8fb887-d8de-4cfe-b9d2-8efca470699e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707e478fa5c24fe8bebe1abeed803890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:16:07Z,use_quota=True,user_id='0d48d1dc84cb4421b6553a6b4c1196e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e456479-36ad-452c-86c9-39d3653397ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e456479-36ad-452c-86c9-39d3653397ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c056e6-1aff-4eed-beca-992e466a9bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c056e6-1aff-4eed-beca-992e466a9bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df8fb887-d8de-4cfe-b9d2-8efca470699e', 'volume_name': 'volume-df8fb887-d8de-4cfe-b9d2-8efca470699e', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c737b8-bd8a-496d-bc37-81619686695c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c737b8-bd8a-496d-bc37-81619686695c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:06 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b947a5-815b-449e-b86d-d3f584520c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:06 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Volume df8fb887-d8de-4cfe-b9d2-8efca470699e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df8fb887-d8de-4cfe-b9d2-8efca470699e', 'volume_size': 1} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eef1c09a-26c8-4a76-9e95-885ed2ef6787 1073741824" returned: 0 in 0.710s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eef1c09a-26c8-4a76-9e95-885ed2ef6787 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:06 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eef1c09a-26c8-4a76-9e95-885ed2ef6787 Sep 06 08:16:06 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Flow 'volume_create_manager' (3fa33347-6362-438f-a729-990d8f8deb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cca1e3c-b28b-4ef5-b959-01fb432fc445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cca1e3c-b28b-4ef5-b959-01fb432fc445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2012015227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c532b63d-a4ee-47a7-9979-cfea46c9198a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707e478fa5c24fe8bebe1abeed803890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:16:07Z,use_quota=True,user_id='0d48d1dc84cb4421b6553a6b4c1196e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (922035bc-4f53-4757-8a46-bb4507a7e990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (922035bc-4f53-4757-8a46-bb4507a7e990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdd4da2c-d856-410d-8885-92629a556bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:07 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdd4da2c-d856-410d-8885-92629a556bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c532b63d-a4ee-47a7-9979-cfea46c9198a', 'volume_name': 'volume-c532b63d-a4ee-47a7-9979-cfea46c9198a', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (321ec082-dbda-4e20-805a-aa6cdab3c813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (321ec082-dbda-4e20-805a-aa6cdab3c813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08db8512-4736-4fb9-8df7-9eb9b37eeedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:07 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Volume c532b63d-a4ee-47a7-9979-cfea46c9198a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c532b63d-a4ee-47a7-9979-cfea46c9198a', 'volume_size': 1} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eef1c09a-26c8-4a76-9e95-885ed2ef6787" returned: 0 in 0.431s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.474s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-126357676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8fb887-d8de-4cfe-b9d2-8efca470699e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707e478fa5c24fe8bebe1abeed803890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:16:07Z,use_quota=True,user_id='0d48d1dc84cb4421b6553a6b4c1196e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Creating volume df8fb887-d8de-4cfe-b9d2-8efca470699e {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:16:07 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df8fb887-d8de-4cfe-b9d2-8efca470699e 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595f56bb-59ac-4a66-a72a-00a99793479f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eef1c09a-26c8-4a76-9e95-885ed2ef6787', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:07 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df8fb887-d8de-4cfe-b9d2-8efca470699e 1073741824 Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad59458-a4f9-4e94-8cea-46c315e52dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:07 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:07 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Volume volume-eef1c09a-26c8-4a76-9e95-885ed2ef6787 (eef1c09a-26c8-4a76-9e95-885ed2ef6787): created successfully Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad59458-a4f9-4e94-8cea-46c315e52dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Flow 'volume_create_manager' (6158fa25-5e84-467e-b32f-74150bb33c8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:16:07 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-8cad59ab-cfdf-42ae-ab97-bd5ee65a7aac tempest-CreateVolumesFromImageTest-44581646 None] Created volume successfully. Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Flow 'volume_create_manager' (00179e7f-f99f-4a14-98dc-f60f6c7c9a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa1c6951-6968-4d11-8f73-acc817a17478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa1c6951-6968-4d11-8f73-acc817a17478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1773240952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8c95f14-cb42-4974-a08f-2238a45af751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707e478fa5c24fe8bebe1abeed803890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:16:08Z,use_quota=True,user_id='0d48d1dc84cb4421b6553a6b4c1196e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (875be1c4-6f61-4621-ad14-3e0f091b8aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (875be1c4-6f61-4621-ad14-3e0f091b8aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a224d3-4ce1-43e8-8cae-6b9caad0a3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a224d3-4ce1-43e8-8cae-6b9caad0a3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8c95f14-cb42-4974-a08f-2238a45af751', 'volume_name': 'volume-b8c95f14-cb42-4974-a08f-2238a45af751', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19293fef-5adf-4842-8077-a402d1327792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19293fef-5adf-4842-8077-a402d1327792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e691b34c-49f8-4f48-bba1-edade4c93f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:07 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Volume b8c95f14-cb42-4974-a08f-2238a45af751: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8c95f14-cb42-4974-a08f-2238a45af751', 'volume_size': 1} Sep 06 08:16:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:08 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df8fb887-d8de-4cfe-b9d2-8efca470699e 1073741824" returned: 0 in 0.795s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df8fb887-d8de-4cfe-b9d2-8efca470699e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:08 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df8fb887-d8de-4cfe-b9d2-8efca470699e Sep 06 08:16:08 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Flow 'volume_create_manager' (ee7376cb-f5fa-4cca-9c6c-a9b33b62e12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b71bc4a4-1baa-4861-9745-ae0d3fd54abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b71bc4a4-1baa-4861-9745-ae0d3fd54abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1679271562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0473130c-1fbb-493e-a5a3-b71d56d5b684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707e478fa5c24fe8bebe1abeed803890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:16:08Z,use_quota=True,user_id='0d48d1dc84cb4421b6553a6b4c1196e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c45762da-6e9c-48dd-9e99-15833debaec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c45762da-6e9c-48dd-9e99-15833debaec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c495b27e-537e-4569-9ca8-a2257fd69c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c495b27e-537e-4569-9ca8-a2257fd69c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0473130c-1fbb-493e-a5a3-b71d56d5b684', 'volume_name': 'volume-0473130c-1fbb-493e-a5a3-b71d56d5b684', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1196cabd-d0dc-438c-9406-1f5cee55e199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1196cabd-d0dc-438c-9406-1f5cee55e199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14875ed0-b073-440a-b8b9-730173b5a796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:08 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Volume 0473130c-1fbb-493e-a5a3-b71d56d5b684: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0473130c-1fbb-493e-a5a3-b71d56d5b684', 'volume_size': 1} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:08 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df8fb887-d8de-4cfe-b9d2-8efca470699e" returned: 0 in 0.322s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.220s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2012015227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c532b63d-a4ee-47a7-9979-cfea46c9198a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707e478fa5c24fe8bebe1abeed803890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:16:07Z,use_quota=True,user_id='0d48d1dc84cb4421b6553a6b4c1196e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Creating volume c532b63d-a4ee-47a7-9979-cfea46c9198a {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:16:08 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c532b63d-a4ee-47a7-9979-cfea46c9198a 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b947a5-815b-449e-b86d-d3f584520c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df8fb887-d8de-4cfe-b9d2-8efca470699e', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:08 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c532b63d-a4ee-47a7-9979-cfea46c9198a 1073741824 Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47cdfbd9-3aa5-43ee-8666-e159e861d7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:08 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:08 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Volume volume-df8fb887-d8de-4cfe-b9d2-8efca470699e (df8fb887-d8de-4cfe-b9d2-8efca470699e): created successfully Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47cdfbd9-3aa5-43ee-8666-e159e861d7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Flow 'volume_create_manager' (f17d3032-9cd3-491b-8cba-3da19e45fadb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:16:08 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-ba19300a-a515-4eec-9cce-1d14cfffc2b8 tempest-CreateVolumesFromImageTest-44581646 None] Created volume successfully. Sep 06 08:16:09 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c532b63d-a4ee-47a7-9979-cfea46c9198a 1073741824" returned: 0 in 0.553s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c532b63d-a4ee-47a7-9979-cfea46c9198a {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:09 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c532b63d-a4ee-47a7-9979-cfea46c9198a Sep 06 08:16:09 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:09 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c532b63d-a4ee-47a7-9979-cfea46c9198a" returned: 0 in 0.378s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:09 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:16:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.626s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:09 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1773240952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8c95f14-cb42-4974-a08f-2238a45af751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707e478fa5c24fe8bebe1abeed803890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:16:08Z,use_quota=True,user_id='0d48d1dc84cb4421b6553a6b4c1196e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:16:09 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Creating volume b8c95f14-cb42-4974-a08f-2238a45af751 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:16:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:09 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:16:09 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:16:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:09 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:16:09 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:16:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c95f14-cb42-4974-a08f-2238a45af751 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:09 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08db8512-4736-4fb9-8df7-9eb9b37eeedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c532b63d-a4ee-47a7-9979-cfea46c9198a', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:09 devstack sudo[101955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c95f14-cb42-4974-a08f-2238a45af751 1073741824 Sep 06 08:16:09 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:09 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26eae9e9-4db5-4796-bf0e-d512c0e8538a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:09 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Volume volume-c532b63d-a4ee-47a7-9979-cfea46c9198a (c532b63d-a4ee-47a7-9979-cfea46c9198a): created successfully Sep 06 08:16:09 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26eae9e9-4db5-4796-bf0e-d512c0e8538a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:09 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Flow 'volume_create_manager' (3fa33347-6362-438f-a729-990d8f8deb3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:16:09 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-1482f576-2783-4301-ad2d-c029f0656081 tempest-CreateVolumesFromImageTest-44581646 None] Created volume successfully. Sep 06 08:16:10 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c95f14-cb42-4974-a08f-2238a45af751 1073741824" returned: 0 in 0.559s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c95f14-cb42-4974-a08f-2238a45af751 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:10 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c95f14-cb42-4974-a08f-2238a45af751 Sep 06 08:16:10 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:10 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c95f14-cb42-4974-a08f-2238a45af751" returned: 0 in 0.284s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:16:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.040s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1679271562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0473130c-1fbb-493e-a5a3-b71d56d5b684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707e478fa5c24fe8bebe1abeed803890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:16:08Z,use_quota=True,user_id='0d48d1dc84cb4421b6553a6b4c1196e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:16:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Creating volume 0473130c-1fbb-493e-a5a3-b71d56d5b684 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:16:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:16:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:16:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:16:10 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:16:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0473130c-1fbb-493e-a5a3-b71d56d5b684 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e691b34c-49f8-4f48-bba1-edade4c93f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8c95f14-cb42-4974-a08f-2238a45af751', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:10 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0473130c-1fbb-493e-a5a3-b71d56d5b684 1073741824 Sep 06 08:16:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbac98b6-65f4-402b-9af4-6810cd33e728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:10 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:10 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Volume volume-b8c95f14-cb42-4974-a08f-2238a45af751 (b8c95f14-cb42-4974-a08f-2238a45af751): created successfully Sep 06 08:16:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbac98b6-65f4-402b-9af4-6810cd33e728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:10 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Flow 'volume_create_manager' (00179e7f-f99f-4a14-98dc-f60f6c7c9a49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:16:10 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-22187cb9-71ad-4bc3-b6fe-ccf25cb34afc tempest-CreateVolumesFromImageTest-44581646 None] Created volume successfully. Sep 06 08:16:11 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0473130c-1fbb-493e-a5a3-b71d56d5b684 1073741824" returned: 0 in 0.669s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0473130c-1fbb-493e-a5a3-b71d56d5b684 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:11 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0473130c-1fbb-493e-a5a3-b71d56d5b684 Sep 06 08:16:11 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:11 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0473130c-1fbb-493e-a5a3-b71d56d5b684" returned: 0 in 0.269s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:16:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14875ed0-b073-440a-b8b9-730173b5a796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0473130c-1fbb-493e-a5a3-b71d56d5b684', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (743b1932-2124-4691-bed8-5e0c083413b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:11 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Volume volume-0473130c-1fbb-493e-a5a3-b71d56d5b684 (0473130c-1fbb-493e-a5a3-b71d56d5b684): created successfully Sep 06 08:16:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (743b1932-2124-4691-bed8-5e0c083413b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:11 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Flow 'volume_create_manager' (ee7376cb-f5fa-4cca-9c6c-a9b33b62e12a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:16:11 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-242da65a-6c26-4af1-9e32-b50d80d6565c tempest-CreateVolumesFromImageTest-44581646 None] Created volume successfully. Sep 06 08:16:11 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7c588ad6-13f5-4bc1-ad94-d4d7492f3b08 tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "cinder-0473130c-1fbb-493e-a5a3-b71d56d5b684-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:11 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7c588ad6-13f5-4bc1-ad94-d4d7492f3b08 tempest-CreateVolumesFromImageTest-44581646 None] Lock "cinder-0473130c-1fbb-493e-a5a3-b71d56d5b684-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:12 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7c588ad6-13f5-4bc1-ad94-d4d7492f3b08 tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "cinder-quobyte-0473130c-1fbb-493e-a5a3-b71d56d5b684" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:12 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7c588ad6-13f5-4bc1-ad94-d4d7492f3b08 tempest-CreateVolumesFromImageTest-44581646 None] Lock "cinder-quobyte-0473130c-1fbb-493e-a5a3-b71d56d5b684" acquired by "delete_volume" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:12 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c2fbdb-0119-4471-95b5-6cb04f6672e8]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:16:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7c588ad6-13f5-4bc1-ad94-d4d7492f3b08 tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0473130c-1fbb-493e-a5a3-b71d56d5b684 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:12 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0473130c-1fbb-493e-a5a3-b71d56d5b684 Sep 06 08:16:12 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:12 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7c588ad6-13f5-4bc1-ad94-d4d7492f3b08 tempest-CreateVolumesFromImageTest-44581646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0473130c-1fbb-493e-a5a3-b71d56d5b684" returned: 0 in 0.412s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7c588ad6-13f5-4bc1-ad94-d4d7492f3b08 tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0473130c-1fbb-493e-a5a3-b71d56d5b684 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:12 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0473130c-1fbb-493e-a5a3-b71d56d5b684 Sep 06 08:16:12 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:12 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7c588ad6-13f5-4bc1-ad94-d4d7492f3b08 tempest-CreateVolumesFromImageTest-44581646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0473130c-1fbb-493e-a5a3-b71d56d5b684" returned: 0 in 0.318s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:12 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7c588ad6-13f5-4bc1-ad94-d4d7492f3b08 tempest-CreateVolumesFromImageTest-44581646 None] Lock "cinder-quobyte-0473130c-1fbb-493e-a5a3-b71d56d5b684" released by "delete_volume" :: held 0.785s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:12 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-7c588ad6-13f5-4bc1-ad94-d4d7492f3b08 tempest-CreateVolumesFromImageTest-44581646 None] Created reservations ['c5cb11af-8a35-4257-8eff-d80d84c2321e', 'b2e1e114-6092-4c36-bd99-673ecffc491e', 'e78e48ad-a439-4c2b-8b57-b3dd6c5f794c', 'c5afa0d9-88fd-4de2-a27d-408e48806d2d'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:16:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7c588ad6-13f5-4bc1-ad94-d4d7492f3b08 tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7c588ad6-13f5-4bc1-ad94-d4d7492f3b08 tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:12 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7c588ad6-13f5-4bc1-ad94-d4d7492f3b08 tempest-CreateVolumesFromImageTest-44581646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:16:12 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7c588ad6-13f5-4bc1-ad94-d4d7492f3b08 tempest-CreateVolumesFromImageTest-44581646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:16:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7c588ad6-13f5-4bc1-ad94-d4d7492f3b08 tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7c588ad6-13f5-4bc1-ad94-d4d7492f3b08 tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:13 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:16:13 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-032a92dd-8b34-4e1b-b88c-9c53470dfa77 tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "cinder-b8c95f14-cb42-4974-a08f-2238a45af751-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-032a92dd-8b34-4e1b-b88c-9c53470dfa77 tempest-CreateVolumesFromImageTest-44581646 None] Lock "cinder-b8c95f14-cb42-4974-a08f-2238a45af751-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-032a92dd-8b34-4e1b-b88c-9c53470dfa77 tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "cinder-quobyte-b8c95f14-cb42-4974-a08f-2238a45af751" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-032a92dd-8b34-4e1b-b88c-9c53470dfa77 tempest-CreateVolumesFromImageTest-44581646 None] Lock "cinder-quobyte-b8c95f14-cb42-4974-a08f-2238a45af751" acquired by "delete_volume" :: waited 0.026s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:13 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7c588ad6-13f5-4bc1-ad94-d4d7492f3b08 tempest-CreateVolumesFromImageTest-44581646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.344s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:13 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-7c588ad6-13f5-4bc1-ad94-d4d7492f3b08 tempest-CreateVolumesFromImageTest-44581646 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:16:13 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2760dd3c-77b9-4656-8368-5385ae2210d7]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:16:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-032a92dd-8b34-4e1b-b88c-9c53470dfa77 tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c95f14-cb42-4974-a08f-2238a45af751 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:13 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-7c588ad6-13f5-4bc1-ad94-d4d7492f3b08 tempest-CreateVolumesFromImageTest-44581646 None] Deleted volume successfully. Sep 06 08:16:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7c588ad6-13f5-4bc1-ad94-d4d7492f3b08 tempest-CreateVolumesFromImageTest-44581646 None] Lock "cinder-0473130c-1fbb-493e-a5a3-b71d56d5b684-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:13 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c95f14-cb42-4974-a08f-2238a45af751 Sep 06 08:16:13 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:13 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-032a92dd-8b34-4e1b-b88c-9c53470dfa77 tempest-CreateVolumesFromImageTest-44581646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c95f14-cb42-4974-a08f-2238a45af751" returned: 0 in 0.486s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-032a92dd-8b34-4e1b-b88c-9c53470dfa77 tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c95f14-cb42-4974-a08f-2238a45af751 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:13 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c95f14-cb42-4974-a08f-2238a45af751 Sep 06 08:16:13 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:14 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-032a92dd-8b34-4e1b-b88c-9c53470dfa77 tempest-CreateVolumesFromImageTest-44581646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b8c95f14-cb42-4974-a08f-2238a45af751" returned: 0 in 0.295s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:14 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-032a92dd-8b34-4e1b-b88c-9c53470dfa77 tempest-CreateVolumesFromImageTest-44581646 None] Lock "cinder-quobyte-b8c95f14-cb42-4974-a08f-2238a45af751" released by "delete_volume" :: held 0.845s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:14 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-032a92dd-8b34-4e1b-b88c-9c53470dfa77 tempest-CreateVolumesFromImageTest-44581646 None] Created reservations ['8b13027d-c18d-49b2-8354-fd2faa5fd20f', '7f9a8ee0-efb8-492c-b625-a9fbcedf21bc', '4d6517ec-c496-4eb5-abdd-6b6d6fb359e0', 'd01bcf32-c891-44fa-a5e9-9bec4c916eb9'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:16:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-032a92dd-8b34-4e1b-b88c-9c53470dfa77 tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-032a92dd-8b34-4e1b-b88c-9c53470dfa77 tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-032a92dd-8b34-4e1b-b88c-9c53470dfa77 tempest-CreateVolumesFromImageTest-44581646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:16:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-032a92dd-8b34-4e1b-b88c-9c53470dfa77 tempest-CreateVolumesFromImageTest-44581646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:16:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-032a92dd-8b34-4e1b-b88c-9c53470dfa77 tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-032a92dd-8b34-4e1b-b88c-9c53470dfa77 tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:14 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-06ed608e-b2ec-48d1-82e1-4b4838d3416a tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "cinder-c532b63d-a4ee-47a7-9979-cfea46c9198a-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:14 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:16:14 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:14 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-06ed608e-b2ec-48d1-82e1-4b4838d3416a tempest-CreateVolumesFromImageTest-44581646 None] Lock "cinder-c532b63d-a4ee-47a7-9979-cfea46c9198a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:14 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-06ed608e-b2ec-48d1-82e1-4b4838d3416a tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "cinder-quobyte-c532b63d-a4ee-47a7-9979-cfea46c9198a" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:14 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-06ed608e-b2ec-48d1-82e1-4b4838d3416a tempest-CreateVolumesFromImageTest-44581646 None] Lock "cinder-quobyte-c532b63d-a4ee-47a7-9979-cfea46c9198a" acquired by "delete_volume" :: waited 0.038s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:14 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc67a2b2-d936-416d-b41e-ae52427a900b]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:16:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-06ed608e-b2ec-48d1-82e1-4b4838d3416a tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c532b63d-a4ee-47a7-9979-cfea46c9198a {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:14 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-032a92dd-8b34-4e1b-b88c-9c53470dfa77 tempest-CreateVolumesFromImageTest-44581646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.398s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:14 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-032a92dd-8b34-4e1b-b88c-9c53470dfa77 tempest-CreateVolumesFromImageTest-44581646 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:16:14 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-032a92dd-8b34-4e1b-b88c-9c53470dfa77 tempest-CreateVolumesFromImageTest-44581646 None] Deleted volume successfully. Sep 06 08:16:14 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c532b63d-a4ee-47a7-9979-cfea46c9198a Sep 06 08:16:14 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:14 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-032a92dd-8b34-4e1b-b88c-9c53470dfa77 tempest-CreateVolumesFromImageTest-44581646 None] Lock "cinder-b8c95f14-cb42-4974-a08f-2238a45af751-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:15 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-06ed608e-b2ec-48d1-82e1-4b4838d3416a tempest-CreateVolumesFromImageTest-44581646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c532b63d-a4ee-47a7-9979-cfea46c9198a" returned: 0 in 0.528s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-06ed608e-b2ec-48d1-82e1-4b4838d3416a tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c532b63d-a4ee-47a7-9979-cfea46c9198a {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:15 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c532b63d-a4ee-47a7-9979-cfea46c9198a Sep 06 08:16:15 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:15 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-06ed608e-b2ec-48d1-82e1-4b4838d3416a tempest-CreateVolumesFromImageTest-44581646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c532b63d-a4ee-47a7-9979-cfea46c9198a" returned: 0 in 0.339s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:15 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-06ed608e-b2ec-48d1-82e1-4b4838d3416a tempest-CreateVolumesFromImageTest-44581646 None] Lock "cinder-quobyte-c532b63d-a4ee-47a7-9979-cfea46c9198a" released by "delete_volume" :: held 0.944s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:15 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-06ed608e-b2ec-48d1-82e1-4b4838d3416a tempest-CreateVolumesFromImageTest-44581646 None] Created reservations ['5b4d457e-ca2e-40ec-84b6-6a39810d2774', 'e130e404-451a-4cc3-8342-4c9dd0518375', 'bfe40ff6-4d80-4e81-a0f8-2e515fa37eb6', '93c5a6c9-9d9a-4723-b33a-79e970153e2c'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:16:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-06ed608e-b2ec-48d1-82e1-4b4838d3416a tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-06ed608e-b2ec-48d1-82e1-4b4838d3416a tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:15 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-06ed608e-b2ec-48d1-82e1-4b4838d3416a tempest-CreateVolumesFromImageTest-44581646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:16:15 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-06ed608e-b2ec-48d1-82e1-4b4838d3416a tempest-CreateVolumesFromImageTest-44581646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:16:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-06ed608e-b2ec-48d1-82e1-4b4838d3416a tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-06ed608e-b2ec-48d1-82e1-4b4838d3416a tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:15 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:16:15 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:15 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:16:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Flow 'volume_create_manager' (57ad2be8-4849-41e7-a617-ffb57486c836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:16:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e83067d-012a-40d2-b876-92cab16ac7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e83067d-012a-40d2-b876-92cab16ac7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1829745704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f7fb36-cb56-4390-8ff4-21c2b8a702d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ce56c2fd1e42b0a05bb1485ef48f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:16:16Z,use_quota=True,user_id='956c75f1a1864f4ea1343399913ec72f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ce1e72a-4a97-42ee-ab00-4f11521e9b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ce1e72a-4a97-42ee-ab00-4f11521e9b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c99048a-6662-48d8-9810-7ddb46992767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c99048a-6662-48d8-9810-7ddb46992767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0f7fb36-cb56-4390-8ff4-21c2b8a702d8', 'volume_name': 'volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca17a26-d80b-4e4e-a511-63e3df212089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca17a26-d80b-4e4e-a511-63e3df212089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd8d9fd-57ab-4f85-a602-cd7187bbfd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:16 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Volume c0f7fb36-cb56-4390-8ff4-21c2b8a702d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8', 'volume_size': 1} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:16 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1829745704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f7fb36-cb56-4390-8ff4-21c2b8a702d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ce56c2fd1e42b0a05bb1485ef48f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:16:16Z,use_quota=True,user_id='956c75f1a1864f4ea1343399913ec72f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Creating volume c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:16:16 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-06ed608e-b2ec-48d1-82e1-4b4838d3416a tempest-CreateVolumesFromImageTest-44581646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.432s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-06ed608e-b2ec-48d1-82e1-4b4838d3416a tempest-CreateVolumesFromImageTest-44581646 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:16:16 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-06ed608e-b2ec-48d1-82e1-4b4838d3416a tempest-CreateVolumesFromImageTest-44581646 None] Deleted volume successfully. Sep 06 08:16:16 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 1073741824 Sep 06 08:16:16 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-06ed608e-b2ec-48d1-82e1-4b4838d3416a tempest-CreateVolumesFromImageTest-44581646 None] Lock "cinder-c532b63d-a4ee-47a7-9979-cfea46c9198a-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:16 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 1073741824" returned: 0 in 0.556s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e01b17a0-6b1c-4146-a482-942955d8ffb8 tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "cinder-df8fb887-d8de-4cfe-b9d2-8efca470699e-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:16 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 Sep 06 08:16:16 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e01b17a0-6b1c-4146-a482-942955d8ffb8 tempest-CreateVolumesFromImageTest-44581646 None] Lock "cinder-df8fb887-d8de-4cfe-b9d2-8efca470699e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e01b17a0-6b1c-4146-a482-942955d8ffb8 tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "cinder-quobyte-df8fb887-d8de-4cfe-b9d2-8efca470699e" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e01b17a0-6b1c-4146-a482-942955d8ffb8 tempest-CreateVolumesFromImageTest-44581646 None] Lock "cinder-quobyte-df8fb887-d8de-4cfe-b9d2-8efca470699e" acquired by "delete_volume" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfcebb5-0110-45e4-b7d5-1f1d7cb07099]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e01b17a0-6b1c-4146-a482-942955d8ffb8 tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df8fb887-d8de-4cfe-b9d2-8efca470699e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:16 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df8fb887-d8de-4cfe-b9d2-8efca470699e Sep 06 08:16:16 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:16 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8" returned: 0 in 0.315s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:16:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd8d9fd-57ab-4f85-a602-cd7187bbfd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd2b373-c7f4-4431-ac52-89e71ebd5bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:17 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Volume volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 (c0f7fb36-cb56-4390-8ff4-21c2b8a702d8): created successfully Sep 06 08:16:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd2b373-c7f4-4431-ac52-89e71ebd5bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Flow 'volume_create_manager' (57ad2be8-4849-41e7-a617-ffb57486c836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:16:17 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-6d4e95c8-7bb0-400b-a7dd-1da9ab8e76b0 tempest-VolumesActionsTest-1129160947 None] Created volume successfully. Sep 06 08:16:17 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e01b17a0-6b1c-4146-a482-942955d8ffb8 tempest-CreateVolumesFromImageTest-44581646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df8fb887-d8de-4cfe-b9d2-8efca470699e" returned: 0 in 0.500s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e01b17a0-6b1c-4146-a482-942955d8ffb8 tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df8fb887-d8de-4cfe-b9d2-8efca470699e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:17 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df8fb887-d8de-4cfe-b9d2-8efca470699e Sep 06 08:16:17 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:17 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e01b17a0-6b1c-4146-a482-942955d8ffb8 tempest-CreateVolumesFromImageTest-44581646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-df8fb887-d8de-4cfe-b9d2-8efca470699e" returned: 0 in 0.290s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:17 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e01b17a0-6b1c-4146-a482-942955d8ffb8 tempest-CreateVolumesFromImageTest-44581646 None] Lock "cinder-quobyte-df8fb887-d8de-4cfe-b9d2-8efca470699e" released by "delete_volume" :: held 0.848s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:17 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-e01b17a0-6b1c-4146-a482-942955d8ffb8 tempest-CreateVolumesFromImageTest-44581646 None] Created reservations ['a6067d9e-35e2-43d4-a20e-5a0e25466012', 'cb3967c6-3a95-4c28-b37c-f0709cb6f3aa', '3e5f9377-e519-4328-8363-75b7424f5705', 'ea287b7e-bb0f-4d44-b390-85db8758134e'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:16:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e01b17a0-6b1c-4146-a482-942955d8ffb8 tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e01b17a0-6b1c-4146-a482-942955d8ffb8 tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e01b17a0-6b1c-4146-a482-942955d8ffb8 tempest-CreateVolumesFromImageTest-44581646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:16:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e01b17a0-6b1c-4146-a482-942955d8ffb8 tempest-CreateVolumesFromImageTest-44581646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:16:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e01b17a0-6b1c-4146-a482-942955d8ffb8 tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e01b17a0-6b1c-4146-a482-942955d8ffb8 tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:17 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:16:17 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:17 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ac87f79c-4331-4ba0-a74e-db56d209b0fb tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "cinder-eef1c09a-26c8-4a76-9e95-885ed2ef6787-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:17 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ac87f79c-4331-4ba0-a74e-db56d209b0fb tempest-CreateVolumesFromImageTest-44581646 None] Lock "cinder-eef1c09a-26c8-4a76-9e95-885ed2ef6787-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:18 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ac87f79c-4331-4ba0-a74e-db56d209b0fb tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "cinder-quobyte-eef1c09a-26c8-4a76-9e95-885ed2ef6787" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:18 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:18 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ac87f79c-4331-4ba0-a74e-db56d209b0fb tempest-CreateVolumesFromImageTest-44581646 None] Lock "cinder-quobyte-eef1c09a-26c8-4a76-9e95-885ed2ef6787" acquired by "delete_volume" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e01b17a0-6b1c-4146-a482-942955d8ffb8 tempest-CreateVolumesFromImageTest-44581646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.322s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:18 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-e01b17a0-6b1c-4146-a482-942955d8ffb8 tempest-CreateVolumesFromImageTest-44581646 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:16:18 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e01b17a0-6b1c-4146-a482-942955d8ffb8 tempest-CreateVolumesFromImageTest-44581646 None] Deleted volume successfully. Sep 06 08:16:18 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b257694-8ca2-47a6-8a8a-b1a20e4385f0]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:16:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ac87f79c-4331-4ba0-a74e-db56d209b0fb tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eef1c09a-26c8-4a76-9e95-885ed2ef6787 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:18 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e01b17a0-6b1c-4146-a482-942955d8ffb8 tempest-CreateVolumesFromImageTest-44581646 None] Lock "cinder-df8fb887-d8de-4cfe-b9d2-8efca470699e-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:18 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eef1c09a-26c8-4a76-9e95-885ed2ef6787 Sep 06 08:16:18 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:18 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ac87f79c-4331-4ba0-a74e-db56d209b0fb tempest-CreateVolumesFromImageTest-44581646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eef1c09a-26c8-4a76-9e95-885ed2ef6787" returned: 0 in 0.451s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ac87f79c-4331-4ba0-a74e-db56d209b0fb tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eef1c09a-26c8-4a76-9e95-885ed2ef6787 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:18 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eef1c09a-26c8-4a76-9e95-885ed2ef6787 Sep 06 08:16:18 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:18 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ac87f79c-4331-4ba0-a74e-db56d209b0fb tempest-CreateVolumesFromImageTest-44581646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eef1c09a-26c8-4a76-9e95-885ed2ef6787" returned: 0 in 0.328s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:18 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ac87f79c-4331-4ba0-a74e-db56d209b0fb tempest-CreateVolumesFromImageTest-44581646 None] Lock "cinder-quobyte-eef1c09a-26c8-4a76-9e95-885ed2ef6787" released by "delete_volume" :: held 0.847s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:18 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-ac87f79c-4331-4ba0-a74e-db56d209b0fb tempest-CreateVolumesFromImageTest-44581646 None] Created reservations ['c41ea97a-dd31-491d-9207-ec4e22dd943f', '35b37302-f4d7-402c-8aad-c72f5f23d376', '633033cf-d43e-4e4e-8e6e-0e9be0e712ed', '80841d2f-da81-4604-9b67-3a0463ebb399'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:16:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ac87f79c-4331-4ba0-a74e-db56d209b0fb tempest-CreateVolumesFromImageTest-44581646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ac87f79c-4331-4ba0-a74e-db56d209b0fb tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ac87f79c-4331-4ba0-a74e-db56d209b0fb tempest-CreateVolumesFromImageTest-44581646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:16:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ac87f79c-4331-4ba0-a74e-db56d209b0fb tempest-CreateVolumesFromImageTest-44581646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:16:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ac87f79c-4331-4ba0-a74e-db56d209b0fb tempest-CreateVolumesFromImageTest-44581646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ac87f79c-4331-4ba0-a74e-db56d209b0fb tempest-CreateVolumesFromImageTest-44581646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:19 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:16:19 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:19 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ac87f79c-4331-4ba0-a74e-db56d209b0fb tempest-CreateVolumesFromImageTest-44581646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.332s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:19 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-ac87f79c-4331-4ba0-a74e-db56d209b0fb tempest-CreateVolumesFromImageTest-44581646 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:16:19 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-ac87f79c-4331-4ba0-a74e-db56d209b0fb tempest-CreateVolumesFromImageTest-44581646 None] Deleted volume successfully. Sep 06 08:16:19 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ac87f79c-4331-4ba0-a74e-db56d209b0fb tempest-CreateVolumesFromImageTest-44581646 None] Lock "cinder-eef1c09a-26c8-4a76-9e95-885ed2ef6787-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:26 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=155,cinder:INSERT=51,cinder:UPDATE=204,cinder:DELETE=12 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:16:26 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:16:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Flow 'volume_create_manager' (f6047d23-1d68-4f1d-b57e-dfcd36ee09d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:16:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6210655d-923c-47b7-aff2-e07ff65eaba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c24a2b27-cc5a-4fe3-a844-8dc18f6ea682 tempest-VolumesActionsTest-1129160947 None] Acquiring lock "cinder-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8" by "attach_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6210655d-923c-47b7-aff2-e07ff65eaba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204daddc-59d4-4208-b19b-dcfa013f0e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f3277ce7f349b8ad697ed9d1ad1ca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:16:27Z,use_quota=True,user_id='1e91c4f5cc62441a834dfd95356a4a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f942d48e-c1f7-4db6-b77b-7142ef6a994b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f942d48e-c1f7-4db6-b77b-7142ef6a994b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1d82ca1-ed78-4ed6-8c36-a13686efb347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:26 devstack cinder-volume[87307]: DEBUG cinder.image.glance [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Creating Keystone auth plugin from conf {{(pid=87307) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 08:16:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c24a2b27-cc5a-4fe3-a844-8dc18f6ea682 tempest-VolumesActionsTest-1129160947 None] Lock "cinder-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8" acquired by "attach_volume" :: waited 0.090s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:26 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-c24a2b27-cc5a-4fe3-a844-8dc18f6ea682 tempest-VolumesActionsTest-1129160947 None] Attaching volume c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 to instance 2be5fbe7-43ce-44f2-ac92-70a25241ece2 at mountpoint /dev/vdb on host None. Sep 06 08:16:27 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-c24a2b27-cc5a-4fe3-a844-8dc18f6ea682 tempest-VolumesActionsTest-1129160947 None] Attach volume completed successfully. Sep 06 08:16:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c24a2b27-cc5a-4fe3-a844-8dc18f6ea682 tempest-VolumesActionsTest-1129160947 None] Lock "cinder-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8" released by "attach_volume" :: held 0.148s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-69b464cb-42db-4193-b748-9f552b200485 tempest-VolumesActionsTest-1129160947 None] Acquiring lock "cinder-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8-detach_volume" by "detach_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-69b464cb-42db-4193-b748-9f552b200485 tempest-VolumesActionsTest-1129160947 None] Lock "cinder-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:27 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-69b464cb-42db-4193-b748-9f552b200485 tempest-VolumesActionsTest-1129160947 None] Detaching volume c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 from instance 2be5fbe7-43ce-44f2-ac92-70a25241ece2. Sep 06 08:16:27 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-69b464cb-42db-4193-b748-9f552b200485 tempest-VolumesActionsTest-1129160947 None] Detach volume completed successfully. Sep 06 08:16:27 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1d82ca1-ed78-4ed6-8c36-a13686efb347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '204daddc-59d4-4208-b19b-dcfa013f0e50', 'volume_name': 'volume-204daddc-59d4-4208-b19b-dcfa013f0e50', 'volume_size': 1, 'image_id': 'a4c51d1a-8c32-4eb7-be73-6c8263babdc0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4c51d1a-8c32-4eb7-be73-6c8263babdc0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a1d1b402630bd7d86ebaaf06e21be376', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '27f3277ce7f349b8ad697ed9d1ad1ca4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3902192e2fbb68b6d1daffe380b47d5e2174856ff0d81ecd363e64ef2536288e1686710df7e470c96ffd2ab06f6897dee0b1d32dd80a4ef1ac84b871e8ecaacf', 'id': 'a4c51d1a-8c32-4eb7-be73-6c8263babdc0', 'created_at': datetime.datetime(2026, 9, 6, 6, 16, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 6, 16, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4c51d1a-8c32-4eb7-be73-6c8263babdc0/file', 'properties': {}}, 'image_service': }' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:27 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad539a57-8e4e-4486-bd57-55e16bbd6f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:27 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad539a57-8e4e-4486-bd57-55e16bbd6f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:27 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e75e141-9668-469e-ad6b-1d89bf102de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:27 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Volume 204daddc-59d4-4208-b19b-dcfa013f0e50: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-204daddc-59d4-4208-b19b-dcfa013f0e50', 'volume_size': 1, 'image_id': 'a4c51d1a-8c32-4eb7-be73-6c8263babdc0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4c51d1a-8c32-4eb7-be73-6c8263babdc0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a1d1b402630bd7d86ebaaf06e21be376', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '27f3277ce7f349b8ad697ed9d1ad1ca4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3902192e2fbb68b6d1daffe380b47d5e2174856ff0d81ecd363e64ef2536288e1686710df7e470c96ffd2ab06f6897dee0b1d32dd80a4ef1ac84b871e8ecaacf', 'id': 'a4c51d1a-8c32-4eb7-be73-6c8263babdc0', 'created_at': datetime.datetime(2026, 9, 6, 6, 16, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 6, 16, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4c51d1a-8c32-4eb7-be73-6c8263babdc0/file', 'properties': {}}, 'image_service': } Sep 06 08:16:27 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Trying to clone 204daddc-59d4-4208-b19b-dcfa013f0e50 from image a4c51d1a-8c32-4eb7-be73-6c8263babdc0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a4c51d1a-8c32-4eb7-be73-6c8263babdc0', 'metadata': {}}]). {{(pid=87307) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 08:16:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-69b464cb-42db-4193-b748-9f552b200485 tempest-VolumesActionsTest-1129160947 None] Lock "cinder-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8-detach_volume" released by "detach_volume" :: held 0.163s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:27 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 08:16:27 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Image download 0.00 MB at 0.00 MB/s Sep 06 08:16:27 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a396cfe-335e-49b9-902e-e61367242fd2]: (4, 'raw') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:16:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:27 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD Sep 06 08:16:27 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:28 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD" returned: 0 in 0.534s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:28 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD Sep 06 08:16:28 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:28 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD" returned: 1 in 0.526s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 08:16:28 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Temporary image a4c51d1a-8c32-4eb7-be73-6c8263babdc0 is fetched for user 1e91c4f5cc62441a834dfd95356a4a46. {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 08:16:28 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ac2ada-5fb6-419b-a874-fa9f0e6af5e1]: (4, 'raw') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:16:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:28 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD Sep 06 08:16:28 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:29 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:29 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD Sep 06 08:16:29 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:29 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD" returned: 1 in 0.426s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 08:16:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204daddc-59d4-4208-b19b-dcfa013f0e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f3277ce7f349b8ad697ed9d1ad1ca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:16:27Z,use_quota=True,user_id='1e91c4f5cc62441a834dfd95356a4a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:16:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Creating volume 204daddc-59d4-4208-b19b-dcfa013f0e50 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:16:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:16:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:16:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:16:29 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:16:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-204daddc-59d4-4208-b19b-dcfa013f0e50 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:29 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-204daddc-59d4-4208-b19b-dcfa013f0e50 1073741824 Sep 06 08:16:29 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:30 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-204daddc-59d4-4208-b19b-dcfa013f0e50 1073741824" returned: 0 in 0.606s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-204daddc-59d4-4208-b19b-dcfa013f0e50 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:30 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-204daddc-59d4-4208-b19b-dcfa013f0e50 Sep 06 08:16:30 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:30 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-204daddc-59d4-4208-b19b-dcfa013f0e50" returned: 0 in 0.402s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:30 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:16:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:30 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Attempting download of a4c51d1a-8c32-4eb7-be73-6c8263babdc0 ((None, [{'url': 'file:///opt/stack/data/glance/images/a4c51d1a-8c32-4eb7-be73-6c8263babdc0', 'metadata': {}}])) to volume 204daddc-59d4-4208-b19b-dcfa013f0e50. {{(pid=87307) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 08:16:30 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[baeda49d-765b-4f07-b172-00d68452931c]: (4, 'raw') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:16:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_b29lpr1h {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:30 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Flow 'volume_create_manager' (bf09efdf-70ae-4ad8-9ec1-9a72a909407a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029ebd80-fbbc-4413-9003-b4569e343d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029ebd80-fbbc-4413-9003-b4569e343d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1101697838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad3cf55b65544b84ad8d50149d50d2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:16:31Z,use_quota=True,user_id='a53263825ee343189f6c8c57f1663b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c1a4860-5e82-4c77-abf5-81872be03fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c1a4860-5e82-4c77-abf5-81872be03fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:31 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_b29lpr1h Sep 06 08:16:31 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39117c0c-7559-4517-81e0-25d4e84fddac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39117c0c-7559-4517-81e0-25d4e84fddac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b', 'volume_name': 'volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517b16ae-099c-4c47-9768-fe0d14889cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517b16ae-099c-4c47-9768-fe0d14889cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9d1cd3-e7e1-49db-825b-e3ba7990e4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:31 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Volume 7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b', 'volume_size': 1} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1101697838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad3cf55b65544b84ad8d50149d50d2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:16:31Z,use_quota=True,user_id='a53263825ee343189f6c8c57f1663b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Creating volume 7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:16:31 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:31 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b 1073741824 Sep 06 08:16:31 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:31 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_b29lpr1h" returned: 0 in 0.443s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_b29lpr1h {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:31 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_b29lpr1h Sep 06 08:16:31 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:31 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b 1073741824" returned: 0 in 0.498s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:31 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:31 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b Sep 06 08:16:31 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_b29lpr1h" returned: 1 in 0.372s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_b29lpr1h' failed. Not Retrying. {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9590713-407a-4030-b67c-417391be0178]: (4, 'raw') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:31 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD Sep 06 08:16:31 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:31 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b" returned: 0 in 0.289s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9d1cd3-e7e1-49db-825b-e3ba7990e4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fc62ca-294b-457f-85c9-af88ca96c067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:32 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Volume volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b (7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b): created successfully Sep 06 08:16:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fc62ca-294b-457f-85c9-af88ca96c067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Flow 'volume_create_manager' (bf09efdf-70ae-4ad8-9ec1-9a72a909407a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:16:32 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-7d79a3ab-06c8-48c0-a810-1224c3e0953f tempest-SnapshotDependencyTests-7118326 None] Created volume successfully. Sep 06 08:16:32 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD" returned: 0 in 0.354s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:32 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD Sep 06 08:16:32 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:32 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD" returned: 1 in 0.343s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 08:16:32 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] a4c51d1a-8c32-4eb7-be73-6c8263babdc0 was raw, converting to qcow2 {{(pid=87307) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 08:16:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-204daddc-59d4-4208-b19b-dcfa013f0e50 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:32 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-204daddc-59d4-4208-b19b-dcfa013f0e50 Sep 06 08:16:32 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:32 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-204daddc-59d4-4208-b19b-dcfa013f0e50" returned: 0 in 0.470s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:32 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a4c51d1a-8c32-4eb7-be73-6c8263babdc0_xaarhhx1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-204daddc-59d4-4208-b19b-dcfa013f0e50 {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:16:32 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Converted 0.00 MB image at 0.00 MB/s Sep 06 08:16:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-204daddc-59d4-4208-b19b-dcfa013f0e50 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:32 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-204daddc-59d4-4208-b19b-dcfa013f0e50 1G Sep 06 08:16:32 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f44db5fa-4581-4cbb-9156-cbd90c49eea5 tempest-SnapshotDependencyTests-7118326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f44db5fa-4581-4cbb-9156-cbd90c49eea5 tempest-SnapshotDependencyTests-7118326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f44db5fa-4581-4cbb-9156-cbd90c49eea5 tempest-SnapshotDependencyTests-7118326 None] Creating offline snapshot a1644673-f16b-4794-b41c-138dae631275 of volume 7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:16:33 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-204daddc-59d4-4208-b19b-dcfa013f0e50 1G" returned: 0 in 0.420s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:33 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Downloaded image a4c51d1a-8c32-4eb7-be73-6c8263babdc0 ((None, [{'url': 'file:///opt/stack/data/glance/images/a4c51d1a-8c32-4eb7-be73-6c8263babdc0', 'metadata': {}}])) to volume 204daddc-59d4-4208-b19b-dcfa013f0e50 successfully. {{(pid=87307) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 08:16:33 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Temporary image a4c51d1a-8c32-4eb7-be73-6c8263babdc0 for user 1e91c4f5cc62441a834dfd95356a4a46 is deleted. {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 08:16:33 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Marking volume 204daddc-59d4-4208-b19b-dcfa013f0e50 as bootable. {{(pid=87307) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 08:16:33 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[664a9b0e-6325-47da-ab73-d6f315c653a6]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:16:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f44db5fa-4581-4cbb-9156-cbd90c49eea5 tempest-SnapshotDependencyTests-7118326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:33 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Copying metadata from image a4c51d1a-8c32-4eb7-be73-6c8263babdc0 to 204daddc-59d4-4208-b19b-dcfa013f0e50. {{(pid=87307) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 08:16:33 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Creating volume glance metadata for volume 204daddc-59d4-4208-b19b-dcfa013f0e50 backed by image a4c51d1a-8c32-4eb7-be73-6c8263babdc0 with: {'image_id': 'a4c51d1a-8c32-4eb7-be73-6c8263babdc0', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a1d1b402630bd7d86ebaaf06e21be376', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87307) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 08:16:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e75e141-9668-469e-ad6b-1d89bf102de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-204daddc-59d4-4208-b19b-dcfa013f0e50', 'volume_size': 1, 'image_id': 'a4c51d1a-8c32-4eb7-be73-6c8263babdc0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4c51d1a-8c32-4eb7-be73-6c8263babdc0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a1d1b402630bd7d86ebaaf06e21be376', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '27f3277ce7f349b8ad697ed9d1ad1ca4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3902192e2fbb68b6d1daffe380b47d5e2174856ff0d81ecd363e64ef2536288e1686710df7e470c96ffd2ab06f6897dee0b1d32dd80a4ef1ac84b871e8ecaacf', 'id': 'a4c51d1a-8c32-4eb7-be73-6c8263babdc0', 'created_at': datetime.datetime(2026, 9, 6, 6, 16, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 6, 16, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4c51d1a-8c32-4eb7-be73-6c8263babdc0/file', 'properties': {}}, 'image_service': }' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8332cba5-6cbf-4649-a4c0-aaf7439ad386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:33 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Volume volume-204daddc-59d4-4208-b19b-dcfa013f0e50 (204daddc-59d4-4208-b19b-dcfa013f0e50): created successfully Sep 06 08:16:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8332cba5-6cbf-4649-a4c0-aaf7439ad386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Flow 'volume_create_manager' (f6047d23-1d68-4f1d-b57e-dfcd36ee09d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:16:33 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b Sep 06 08:16:33 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:33 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-01c4ca82-e5aa-4b69-b49e-885983b27916 tempest-VolumeImageDependencyTests-548317807 None] Created volume successfully. Sep 06 08:16:33 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f44db5fa-4581-4cbb-9156-cbd90c49eea5 tempest-SnapshotDependencyTests-7118326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b" returned: 0 in 0.401s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f44db5fa-4581-4cbb-9156-cbd90c49eea5 tempest-SnapshotDependencyTests-7118326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.a1644673-f16b-4794-b41c-138dae631275 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:33 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.a1644673-f16b-4794-b41c-138dae631275 1G Sep 06 08:16:33 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:34 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7d41ce37-5b0d-4d75-940b-9d99473869b5 tempest-VolumeImageDependencyTests-548317807 None] Acquiring lock "cinder-204daddc-59d4-4208-b19b-dcfa013f0e50-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:34 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:34 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7d41ce37-5b0d-4d75-940b-9d99473869b5 tempest-VolumeImageDependencyTests-548317807 None] Lock "cinder-204daddc-59d4-4208-b19b-dcfa013f0e50-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f44db5fa-4581-4cbb-9156-cbd90c49eea5 tempest-SnapshotDependencyTests-7118326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.a1644673-f16b-4794-b41c-138dae631275 1G" returned: 0 in 0.531s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f44db5fa-4581-4cbb-9156-cbd90c49eea5 tempest-SnapshotDependencyTests-7118326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.a1644673-f16b-4794-b41c-138dae631275 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:34 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7d41ce37-5b0d-4d75-940b-9d99473869b5 tempest-VolumeImageDependencyTests-548317807 None] Acquiring lock "cinder-quobyte-204daddc-59d4-4208-b19b-dcfa013f0e50" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:34 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.a1644673-f16b-4794-b41c-138dae631275 Sep 06 08:16:34 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:34 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7d41ce37-5b0d-4d75-940b-9d99473869b5 tempest-VolumeImageDependencyTests-548317807 None] Lock "cinder-quobyte-204daddc-59d4-4208-b19b-dcfa013f0e50" acquired by "delete_volume" :: waited 0.038s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:34 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3159d0a-3536-43cc-98b6-e30406353dfd]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:16:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7d41ce37-5b0d-4d75-940b-9d99473869b5 tempest-VolumeImageDependencyTests-548317807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-204daddc-59d4-4208-b19b-dcfa013f0e50 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:34 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-204daddc-59d4-4208-b19b-dcfa013f0e50 Sep 06 08:16:34 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:34 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f44db5fa-4581-4cbb-9156-cbd90c49eea5 tempest-SnapshotDependencyTests-7118326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.a1644673-f16b-4794-b41c-138dae631275" returned: 0 in 0.419s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:34 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-f44db5fa-4581-4cbb-9156-cbd90c49eea5 tempest-SnapshotDependencyTests-7118326 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.a1644673-f16b-4794-b41c-138dae631275 is being set with open permissions: ugo+rw Sep 06 08:16:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f44db5fa-4581-4cbb-9156-cbd90c49eea5 tempest-SnapshotDependencyTests-7118326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.a1644673-f16b-4794-b41c-138dae631275 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:34 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.a1644673-f16b-4794-b41c-138dae631275 Sep 06 08:16:34 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:34 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7d41ce37-5b0d-4d75-940b-9d99473869b5 tempest-VolumeImageDependencyTests-548317807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-204daddc-59d4-4208-b19b-dcfa013f0e50" returned: 0 in 0.454s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7d41ce37-5b0d-4d75-940b-9d99473869b5 tempest-VolumeImageDependencyTests-548317807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-204daddc-59d4-4208-b19b-dcfa013f0e50 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:34 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-204daddc-59d4-4208-b19b-dcfa013f0e50 Sep 06 08:16:34 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:35 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f44db5fa-4581-4cbb-9156-cbd90c49eea5 tempest-SnapshotDependencyTests-7118326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.a1644673-f16b-4794-b41c-138dae631275" returned: 0 in 0.311s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f44db5fa-4581-4cbb-9156-cbd90c49eea5 tempest-SnapshotDependencyTests-7118326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:35 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.info Sep 06 08:16:35 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:35 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7d41ce37-5b0d-4d75-940b-9d99473869b5 tempest-VolumeImageDependencyTests-548317807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-204daddc-59d4-4208-b19b-dcfa013f0e50" returned: 0 in 0.438s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:35 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7d41ce37-5b0d-4d75-940b-9d99473869b5 tempest-VolumeImageDependencyTests-548317807 None] Lock "cinder-quobyte-204daddc-59d4-4208-b19b-dcfa013f0e50" released by "delete_volume" :: held 0.959s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:35 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:UPDATE=166,cinder:SELECT=131,cinder:INSERT=51,cinder:DELETE=19 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:16:35 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-7d41ce37-5b0d-4d75-940b-9d99473869b5 tempest-VolumeImageDependencyTests-548317807 None] Created reservations ['fbb7eb0a-12d2-44e2-a94d-c644f5e80cb4', 'e84155e4-d571-4da4-88d4-e5d07620d4be', '3c7eb686-a331-43be-b821-b53ae9b80b81', '146e7ed8-6fd8-4e3c-a43a-bde0dd5dcd1e'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:16:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7d41ce37-5b0d-4d75-940b-9d99473869b5 tempest-VolumeImageDependencyTests-548317807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7d41ce37-5b0d-4d75-940b-9d99473869b5 tempest-VolumeImageDependencyTests-548317807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7d41ce37-5b0d-4d75-940b-9d99473869b5 tempest-VolumeImageDependencyTests-548317807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:16:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7d41ce37-5b0d-4d75-940b-9d99473869b5 tempest-VolumeImageDependencyTests-548317807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:16:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7d41ce37-5b0d-4d75-940b-9d99473869b5 tempest-VolumeImageDependencyTests-548317807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7d41ce37-5b0d-4d75-940b-9d99473869b5 tempest-VolumeImageDependencyTests-548317807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:35 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f44db5fa-4581-4cbb-9156-cbd90c49eea5 tempest-SnapshotDependencyTests-7118326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.info" returned: 0 in 0.517s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:35 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-f44db5fa-4581-4cbb-9156-cbd90c49eea5 tempest-SnapshotDependencyTests-7118326 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.info is being set with open permissions: ugo+rw Sep 06 08:16:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f44db5fa-4581-4cbb-9156-cbd90c49eea5 tempest-SnapshotDependencyTests-7118326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:35 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:16:35 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:35 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.info Sep 06 08:16:35 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:35 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7d41ce37-5b0d-4d75-940b-9d99473869b5 tempest-VolumeImageDependencyTests-548317807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.302s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:35 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-7d41ce37-5b0d-4d75-940b-9d99473869b5 tempest-VolumeImageDependencyTests-548317807 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:16:35 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:35 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-7d41ce37-5b0d-4d75-940b-9d99473869b5 tempest-VolumeImageDependencyTests-548317807 None] Deleted volume successfully. Sep 06 08:16:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f44db5fa-4581-4cbb-9156-cbd90c49eea5 tempest-SnapshotDependencyTests-7118326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.info" returned: 0 in 0.298s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f44db5fa-4581-4cbb-9156-cbd90c49eea5 tempest-SnapshotDependencyTests-7118326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.600s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:35 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7d41ce37-5b0d-4d75-940b-9d99473869b5 tempest-VolumeImageDependencyTests-548317807 None] Lock "cinder-204daddc-59d4-4208-b19b-dcfa013f0e50-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:35 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f44db5fa-4581-4cbb-9156-cbd90c49eea5 tempest-SnapshotDependencyTests-7118326 None] Create snapshot completed successfully Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Flow 'volume_create_manager' (439826ae-719c-4f11-b5ec-6ad6dd11b521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c7a66bf-8799-4168-a273-5b9bc752f26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c7a66bf-8799-4168-a273-5b9bc752f26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97c00e59-b9c9-48aa-8894-2eafa6f9ee41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad3cf55b65544b84ad8d50149d50d2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a1644673-f16b-4794-b41c-138dae631275,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:16:37Z,use_quota=True,user_id='a53263825ee343189f6c8c57f1663b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e531b7-1b40-4e16-9ff1-ac39a0875a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e531b7-1b40-4e16-9ff1-ac39a0875a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466ce236-618b-4882-95de-b86b70d7064f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466ce236-618b-4882-95de-b86b70d7064f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '97c00e59-b9c9-48aa-8894-2eafa6f9ee41', 'volume_name': 'volume-97c00e59-b9c9-48aa-8894-2eafa6f9ee41', 'volume_size': 1, 'snapshot_id': 'a1644673-f16b-4794-b41c-138dae631275'}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94f1c6fa-bec8-404a-bb92-f19b4f78b3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94f1c6fa-bec8-404a-bb92-f19b4f78b3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94a9ee8-7922-486a-85e9-9fd5311ccb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:37 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Volume 97c00e59-b9c9-48aa-8894-2eafa6f9ee41: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-97c00e59-b9c9-48aa-8894-2eafa6f9ee41', 'volume_size': 1, 'snapshot_id': 'a1644673-f16b-4794-b41c-138dae631275'} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Acquiring lock "cinder-quobyte-a1644673-f16b-4794-b41c-138dae631275-97c00e59-b9c9-48aa-8894-2eafa6f9ee41" by "_create_volume_from_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Lock "cinder-quobyte-a1644673-f16b-4794-b41c-138dae631275-97c00e59-b9c9-48aa-8894-2eafa6f9ee41" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Creating volume 97c00e59-b9c9-48aa-8894-2eafa6f9ee41 from snapshot a1644673-f16b-4794-b41c-138dae631275 {{(pid=87307) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Acquiring lock "cinder-quobyte-97c00e59-b9c9-48aa-8894-2eafa6f9ee41" by "_copy_volume_from_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Lock "cinder-quobyte-97c00e59-b9c9-48aa-8894-2eafa6f9ee41" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] snapshot: a1644673-f16b-4794-b41c-138dae631275, volume: 97c00e59-b9c9-48aa-8894-2eafa6f9ee41, {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:37 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7de899-4a36-441f-8f02-06afebece72a]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:16:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.a1644673-f16b-4794-b41c-138dae631275 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:38 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.a1644673-f16b-4794-b41c-138dae631275 Sep 06 08:16:38 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:38 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.a1644673-f16b-4794-b41c-138dae631275" returned: 0 in 0.602s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:38 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:16:38 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[61046eb9-9ccb-4dba-9ab2-5d0d83706a6f]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:16:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:38 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b Sep 06 08:16:38 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:39 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b" returned: 0 in 0.468s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] will copy from snapshot at /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 06 08:16:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Creating direct copy from snapshot {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 06 08:16:39 devstack cinder-volume[87307]: DEBUG cinder.utils [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Path /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-97c00e59-b9c9-48aa-8894-2eafa6f9ee41 not found in is_blk_device check {{(pid=87307) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 06 08:16:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-97c00e59-b9c9-48aa-8894-2eafa6f9ee41 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:39 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-97c00e59-b9c9-48aa-8894-2eafa6f9ee41 Sep 06 08:16:39 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1e94d885-2add-4137-b451-fd8d8c0b8c00 tempest-VolumesActionsTest-1129160947 None] Acquiring lock "cinder-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8" by "attach_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1e94d885-2add-4137-b451-fd8d8c0b8c00 tempest-VolumesActionsTest-1129160947 None] Lock "cinder-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8" acquired by "attach_volume" :: waited 0.073s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:40 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-1e94d885-2add-4137-b451-fd8d8c0b8c00 tempest-VolumesActionsTest-1129160947 None] Attaching volume c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 to instance 3b5e6ca2-d0e5-4c11-824c-47b9eee60090 at mountpoint /dev/vdb on host None. Sep 06 08:16:41 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-1e94d885-2add-4137-b451-fd8d8c0b8c00 tempest-VolumesActionsTest-1129160947 None] Attach volume completed successfully. Sep 06 08:16:41 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-1e94d885-2add-4137-b451-fd8d8c0b8c00 tempest-VolumesActionsTest-1129160947 None] Lock "cinder-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8" released by "attach_volume" :: held 0.381s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:42 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-328f8cf0-0c8d-490a-9540-c06789179421 tempest-VolumesActionsTest-1129160947 None] Acquiring lock "cinder-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8-detach_volume" by "detach_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:42 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-328f8cf0-0c8d-490a-9540-c06789179421 tempest-VolumesActionsTest-1129160947 None] Lock "cinder-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8-detach_volume" acquired by "detach_volume" :: waited 0.061s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:42 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-328f8cf0-0c8d-490a-9540-c06789179421 tempest-VolumesActionsTest-1129160947 None] Detaching volume c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 from instance 3b5e6ca2-d0e5-4c11-824c-47b9eee60090. Sep 06 08:16:42 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-328f8cf0-0c8d-490a-9540-c06789179421 tempest-VolumesActionsTest-1129160947 None] Detach volume completed successfully. Sep 06 08:16:42 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-328f8cf0-0c8d-490a-9540-c06789179421 tempest-VolumesActionsTest-1129160947 None] Lock "cinder-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8-detach_volume" released by "detach_volume" :: held 0.199s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:46 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-97c00e59-b9c9-48aa-8894-2eafa6f9ee41" returned: 0 in 7.398s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:46 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Image conversion details: src /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b, size 1024.00 MB, duration 7.40 sec, destination /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-97c00e59-b9c9-48aa-8894-2eafa6f9ee41 {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:16:46 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Converted 1024.00 MB image at 138.38 MB/s Sep 06 08:16:46 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-97c00e59-b9c9-48aa-8894-2eafa6f9ee41 is being set with open permissions: ugo+rw Sep 06 08:16:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-97c00e59-b9c9-48aa-8894-2eafa6f9ee41 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:46 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-97c00e59-b9c9-48aa-8894-2eafa6f9ee41 Sep 06 08:16:46 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:46 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-97c00e59-b9c9-48aa-8894-2eafa6f9ee41" returned: 0 in 0.363s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:46 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Lock "cinder-quobyte-97c00e59-b9c9-48aa-8894-2eafa6f9ee41" released by "_copy_volume_from_snapshot" :: held 9.020s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:46 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Lock "cinder-quobyte-a1644673-f16b-4794-b41c-138dae631275-97c00e59-b9c9-48aa-8894-2eafa6f9ee41" released by "_create_volume_from_snapshot" :: held 9.124s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.149s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94a9ee8-7922-486a-85e9-9fd5311ccb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97c00e59-b9c9-48aa-8894-2eafa6f9ee41', 'volume_size': 1, 'snapshot_id': 'a1644673-f16b-4794-b41c-138dae631275'}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c72232-1f80-4cf0-b6cc-bf708ec973b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:46 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Volume volume-97c00e59-b9c9-48aa-8894-2eafa6f9ee41 (97c00e59-b9c9-48aa-8894-2eafa6f9ee41): created successfully Sep 06 08:16:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c72232-1f80-4cf0-b6cc-bf708ec973b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Flow 'volume_create_manager' (439826ae-719c-4f11-b5ec-6ad6dd11b521) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:16:47 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-85bbccd5-3c12-437e-8bae-f7003f1d5c8d tempest-SnapshotDependencyTests-7118326 None] Created volume successfully. Sep 06 08:16:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4b415aeb-fbb4-4e03-8fa3-49a2bacda3ea tempest-SnapshotDependencyTests-7118326 None] Acquiring lock "cinder-a1644673-f16b-4794-b41c-138dae631275-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4b415aeb-fbb4-4e03-8fa3-49a2bacda3ea tempest-SnapshotDependencyTests-7118326 None] Lock "cinder-a1644673-f16b-4794-b41c-138dae631275-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4b415aeb-fbb4-4e03-8fa3-49a2bacda3ea tempest-SnapshotDependencyTests-7118326 None] Acquiring lock "cinder-quobyte-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4b415aeb-fbb4-4e03-8fa3-49a2bacda3ea tempest-SnapshotDependencyTests-7118326 None] Lock "cinder-quobyte-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4b415aeb-fbb4-4e03-8fa3-49a2bacda3ea tempest-SnapshotDependencyTests-7118326 None] Acquiring lock "cinder-quobyte-a1644673-f16b-4794-b41c-138dae631275" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4b415aeb-fbb4-4e03-8fa3-49a2bacda3ea tempest-SnapshotDependencyTests-7118326 None] Lock "cinder-quobyte-a1644673-f16b-4794-b41c-138dae631275" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-4b415aeb-fbb4-4e03-8fa3-49a2bacda3ea tempest-SnapshotDependencyTests-7118326 None] Deleting offline snapshot a1644673-f16b-4794-b41c-138dae631275 of volume 7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:16:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-4b415aeb-fbb4-4e03-8fa3-49a2bacda3ea tempest-SnapshotDependencyTests-7118326 None] snapshot_file for this snap is: volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.a1644673-f16b-4794-b41c-138dae631275 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:16:47 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa46745-9bc8-4057-8218-838b09dcce65]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:16:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4b415aeb-fbb4-4e03-8fa3-49a2bacda3ea tempest-SnapshotDependencyTests-7118326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.a1644673-f16b-4794-b41c-138dae631275 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:47 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.a1644673-f16b-4794-b41c-138dae631275 Sep 06 08:16:47 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:48 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4b415aeb-fbb4-4e03-8fa3-49a2bacda3ea tempest-SnapshotDependencyTests-7118326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.a1644673-f16b-4794-b41c-138dae631275" returned: 0 in 0.418s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:48 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-4b415aeb-fbb4-4e03-8fa3-49a2bacda3ea tempest-SnapshotDependencyTests-7118326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:16:48 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e0c8a2-36c7-4d5d-a9b1-58c629425865]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:16:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4b415aeb-fbb4-4e03-8fa3-49a2bacda3ea tempest-SnapshotDependencyTests-7118326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:48 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b Sep 06 08:16:48 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:48 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4b415aeb-fbb4-4e03-8fa3-49a2bacda3ea tempest-SnapshotDependencyTests-7118326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b" returned: 0 in 0.589s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4b415aeb-fbb4-4e03-8fa3-49a2bacda3ea tempest-SnapshotDependencyTests-7118326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.a1644673-f16b-4794-b41c-138dae631275 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:48 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.a1644673-f16b-4794-b41c-138dae631275 Sep 06 08:16:48 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:49 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4b415aeb-fbb4-4e03-8fa3-49a2bacda3ea tempest-SnapshotDependencyTests-7118326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.a1644673-f16b-4794-b41c-138dae631275" returned: 0 in 0.409s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4b415aeb-fbb4-4e03-8fa3-49a2bacda3ea tempest-SnapshotDependencyTests-7118326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.a1644673-f16b-4794-b41c-138dae631275 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:49 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.a1644673-f16b-4794-b41c-138dae631275 Sep 06 08:16:49 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f1f69c91-4ce5-441f-97f3-b15eac356e5e tempest-VolumesActionsTest-1129160947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f1f69c91-4ce5-441f-97f3-b15eac356e5e tempest-VolumesActionsTest-1129160947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:49 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d289b7-e8ee-4530-b2f6-35b0a575d62d]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:16:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f1f69c91-4ce5-441f-97f3-b15eac356e5e tempest-VolumesActionsTest-1129160947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:49 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4b415aeb-fbb4-4e03-8fa3-49a2bacda3ea tempest-SnapshotDependencyTests-7118326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b.a1644673-f16b-4794-b41c-138dae631275" returned: 0 in 0.291s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:49 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 Sep 06 08:16:49 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:49 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4b415aeb-fbb4-4e03-8fa3-49a2bacda3ea tempest-SnapshotDependencyTests-7118326 None] Lock "cinder-quobyte-a1644673-f16b-4794-b41c-138dae631275" released by "_delete_snapshot" :: held 1.835s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:49 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4b415aeb-fbb4-4e03-8fa3-49a2bacda3ea tempest-SnapshotDependencyTests-7118326 None] Lock "cinder-quobyte-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b" released by "delete_snapshot" :: held 1.863s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:49 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-4b415aeb-fbb4-4e03-8fa3-49a2bacda3ea tempest-SnapshotDependencyTests-7118326 None] Created reservations ['b35f0fc6-0f03-4eb9-9af2-002aecb8044c', 'd29d1be9-a8c3-44c0-b963-836e69143fc0', 'dcbff0f6-db2b-4a50-a4c3-59e9896b7ae9', '3a70bba4-83ce-45cc-bd57-8dca47477274'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:16:49 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-4b415aeb-fbb4-4e03-8fa3-49a2bacda3ea tempest-SnapshotDependencyTests-7118326 None] Delete snapshot completed successfully. Sep 06 08:16:49 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4b415aeb-fbb4-4e03-8fa3-49a2bacda3ea tempest-SnapshotDependencyTests-7118326 None] Lock "cinder-a1644673-f16b-4794-b41c-138dae631275-delete_snapshot" released by "delete_snapshot" :: held 2.025s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:49 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f1f69c91-4ce5-441f-97f3-b15eac356e5e tempest-VolumesActionsTest-1129160947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8" returned: 0 in 0.399s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:49 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a5e0f6-4a12-461f-9954-bf0d215d4402]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:16:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f1f69c91-4ce5-441f-97f3-b15eac356e5e tempest-VolumesActionsTest-1129160947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:49 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-657385c1-7404-44f4-b7f3-eb042aa83f64 tempest-SnapshotDependencyTests-7118326 None] Acquiring lock "cinder-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:49 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-657385c1-7404-44f4-b7f3-eb042aa83f64 tempest-SnapshotDependencyTests-7118326 None] Lock "cinder-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:49 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-657385c1-7404-44f4-b7f3-eb042aa83f64 tempest-SnapshotDependencyTests-7118326 None] Acquiring lock "cinder-quobyte-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:49 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-657385c1-7404-44f4-b7f3-eb042aa83f64 tempest-SnapshotDependencyTests-7118326 None] Lock "cinder-quobyte-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b" acquired by "delete_volume" :: waited 0.030s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:49 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 Sep 06 08:16:49 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:50 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[079c6b37-2e77-440e-af9c-62cbb99dbbd5]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:16:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-657385c1-7404-44f4-b7f3-eb042aa83f64 tempest-SnapshotDependencyTests-7118326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:50 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b Sep 06 08:16:50 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:50 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f1f69c91-4ce5-441f-97f3-b15eac356e5e tempest-VolumesActionsTest-1129160947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8" returned: 0 in 0.533s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f1f69c91-4ce5-441f-97f3-b15eac356e5e tempest-VolumesActionsTest-1129160947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 /opt/stack/data/cinder/conversion/c0f7fb36-cb56-4390-8ff4-21c2b8a702d8.temp_image.9c1596b8-5419-4b4d-b2b0-cbbd0243d9d80zvjkb2a.img {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:50 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 /opt/stack/data/cinder/conversion/c0f7fb36-cb56-4390-8ff4-21c2b8a702d8.temp_image.9c1596b8-5419-4b4d-b2b0-cbbd0243d9d80zvjkb2a.img Sep 06 08:16:50 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:50 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-657385c1-7404-44f4-b7f3-eb042aa83f64 tempest-SnapshotDependencyTests-7118326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b" returned: 0 in 0.436s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-657385c1-7404-44f4-b7f3-eb042aa83f64 tempest-SnapshotDependencyTests-7118326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:50 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b Sep 06 08:16:50 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:50 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-657385c1-7404-44f4-b7f3-eb042aa83f64 tempest-SnapshotDependencyTests-7118326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b" returned: 0 in 0.351s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:50 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-657385c1-7404-44f4-b7f3-eb042aa83f64 tempest-SnapshotDependencyTests-7118326 None] Lock "cinder-quobyte-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b" released by "delete_volume" :: held 0.938s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:51 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-657385c1-7404-44f4-b7f3-eb042aa83f64 tempest-SnapshotDependencyTests-7118326 None] Created reservations ['4d9119c4-07c6-404a-bc9d-7eeb8abc85d3', 'dde7ba5b-9b54-430d-9bbe-90b7cd54dea3', 'bdba1e75-53d5-4e93-bc98-bc7540e04e8b', 'd8ab64a5-c6d1-42b6-b4e5-7d3de3c91e15'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:16:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-657385c1-7404-44f4-b7f3-eb042aa83f64 tempest-SnapshotDependencyTests-7118326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-657385c1-7404-44f4-b7f3-eb042aa83f64 tempest-SnapshotDependencyTests-7118326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-657385c1-7404-44f4-b7f3-eb042aa83f64 tempest-SnapshotDependencyTests-7118326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:16:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-657385c1-7404-44f4-b7f3-eb042aa83f64 tempest-SnapshotDependencyTests-7118326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:16:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-657385c1-7404-44f4-b7f3-eb042aa83f64 tempest-SnapshotDependencyTests-7118326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-657385c1-7404-44f4-b7f3-eb042aa83f64 tempest-SnapshotDependencyTests-7118326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:51 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:16:51 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:52 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-657385c1-7404-44f4-b7f3-eb042aa83f64 tempest-SnapshotDependencyTests-7118326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.769s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:52 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-657385c1-7404-44f4-b7f3-eb042aa83f64 tempest-SnapshotDependencyTests-7118326 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:16:52 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-657385c1-7404-44f4-b7f3-eb042aa83f64 tempest-SnapshotDependencyTests-7118326 None] Deleted volume successfully. Sep 06 08:16:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-657385c1-7404-44f4-b7f3-eb042aa83f64 tempest-SnapshotDependencyTests-7118326 None] Lock "cinder-7974b6c7-bda5-4edb-9dd7-b9a6b5bd8c1b-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0bb96e6e-7426-48e1-9307-9d2f6418b043 tempest-SnapshotDependencyTests-7118326 None] Acquiring lock "cinder-97c00e59-b9c9-48aa-8894-2eafa6f9ee41-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0bb96e6e-7426-48e1-9307-9d2f6418b043 tempest-SnapshotDependencyTests-7118326 None] Lock "cinder-97c00e59-b9c9-48aa-8894-2eafa6f9ee41-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0bb96e6e-7426-48e1-9307-9d2f6418b043 tempest-SnapshotDependencyTests-7118326 None] Acquiring lock "cinder-quobyte-97c00e59-b9c9-48aa-8894-2eafa6f9ee41" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:16:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0bb96e6e-7426-48e1-9307-9d2f6418b043 tempest-SnapshotDependencyTests-7118326 None] Lock "cinder-quobyte-97c00e59-b9c9-48aa-8894-2eafa6f9ee41" acquired by "delete_volume" :: waited 0.026s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:16:52 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cae5cc-b6bf-407e-a566-828006602d2f]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:16:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0bb96e6e-7426-48e1-9307-9d2f6418b043 tempest-SnapshotDependencyTests-7118326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-97c00e59-b9c9-48aa-8894-2eafa6f9ee41 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:53 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-97c00e59-b9c9-48aa-8894-2eafa6f9ee41 Sep 06 08:16:53 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:53 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0bb96e6e-7426-48e1-9307-9d2f6418b043 tempest-SnapshotDependencyTests-7118326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-97c00e59-b9c9-48aa-8894-2eafa6f9ee41" returned: 0 in 0.819s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0bb96e6e-7426-48e1-9307-9d2f6418b043 tempest-SnapshotDependencyTests-7118326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-97c00e59-b9c9-48aa-8894-2eafa6f9ee41 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:53 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-97c00e59-b9c9-48aa-8894-2eafa6f9ee41 Sep 06 08:16:53 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:53 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0bb96e6e-7426-48e1-9307-9d2f6418b043 tempest-SnapshotDependencyTests-7118326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-97c00e59-b9c9-48aa-8894-2eafa6f9ee41" returned: 0 in 0.337s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0bb96e6e-7426-48e1-9307-9d2f6418b043 tempest-SnapshotDependencyTests-7118326 None] Lock "cinder-quobyte-97c00e59-b9c9-48aa-8894-2eafa6f9ee41" released by "delete_volume" :: held 1.273s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:54 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-0bb96e6e-7426-48e1-9307-9d2f6418b043 tempest-SnapshotDependencyTests-7118326 None] Created reservations ['bbdd2e8f-131a-4313-a885-1b956f1b2a1b', '863e7d30-7196-41cb-8660-549f71041e13', 'ffdd578c-c541-443d-ac76-e16a515fafe3', '21448f5e-7922-4472-b668-4fe423927386'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:16:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0bb96e6e-7426-48e1-9307-9d2f6418b043 tempest-SnapshotDependencyTests-7118326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0bb96e6e-7426-48e1-9307-9d2f6418b043 tempest-SnapshotDependencyTests-7118326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0bb96e6e-7426-48e1-9307-9d2f6418b043 tempest-SnapshotDependencyTests-7118326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:16:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0bb96e6e-7426-48e1-9307-9d2f6418b043 tempest-SnapshotDependencyTests-7118326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:16:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0bb96e6e-7426-48e1-9307-9d2f6418b043 tempest-SnapshotDependencyTests-7118326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0bb96e6e-7426-48e1-9307-9d2f6418b043 tempest-SnapshotDependencyTests-7118326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:54 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:16:54 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:55 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0bb96e6e-7426-48e1-9307-9d2f6418b043 tempest-SnapshotDependencyTests-7118326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.691s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:55 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-0bb96e6e-7426-48e1-9307-9d2f6418b043 tempest-SnapshotDependencyTests-7118326 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:16:55 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-0bb96e6e-7426-48e1-9307-9d2f6418b043 tempest-SnapshotDependencyTests-7118326 None] Deleted volume successfully. Sep 06 08:16:55 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0bb96e6e-7426-48e1-9307-9d2f6418b043 tempest-SnapshotDependencyTests-7118326 None] Lock "cinder-97c00e59-b9c9-48aa-8894-2eafa6f9ee41-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:16:56 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f1f69c91-4ce5-441f-97f3-b15eac356e5e tempest-VolumesActionsTest-1129160947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 /opt/stack/data/cinder/conversion/c0f7fb36-cb56-4390-8ff4-21c2b8a702d8.temp_image.9c1596b8-5419-4b4d-b2b0-cbbd0243d9d80zvjkb2a.img" returned: 0 in 5.707s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:56 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fba110-0ac3-498f-bea3-4f4493d6dd1f]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:16:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f1f69c91-4ce5-441f-97f3-b15eac356e5e tempest-VolumesActionsTest-1129160947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:56 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 Sep 06 08:16:56 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:56 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Sep 06 08:16:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f1f69c91-4ce5-441f-97f3-b15eac356e5e tempest-VolumesActionsTest-1129160947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8" returned: 0 in 0.597s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:16:56 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-f1f69c91-4ce5-441f-97f3-b15eac356e5e tempest-VolumesActionsTest-1129160947 None] Image conversion details: src /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8, size 1024.00 MB, duration 5.71 sec, destination /opt/stack/data/cinder/conversion/c0f7fb36-cb56-4390-8ff4-21c2b8a702d8.temp_image.9c1596b8-5419-4b4d-b2b0-cbbd0243d9d80zvjkb2a.img {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:16:56 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-f1f69c91-4ce5-441f-97f3-b15eac356e5e tempest-VolumesActionsTest-1129160947 None] Converted 1024.00 MB image at 179.37 MB/s Sep 06 08:16:56 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-f1f69c91-4ce5-441f-97f3-b15eac356e5e tempest-VolumesActionsTest-1129160947 None] 9c1596b8-5419-4b4d-b2b0-cbbd0243d9d8 was raw, no need to convert to raw {{(pid=87307) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 06 08:16:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:16:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:16:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:16:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:16:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:16:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:16:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:16:59 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:16:59 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:16:59 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:16:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Flow 'volume_create_manager' (67ac53f8-c08b-4e95-b806-c0ff6b7e52bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:16:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e40d4979-d582-4fd1-86d7-988959626037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e40d4979-d582-4fd1-86d7-988959626037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1370057214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a547db5b-2710-4b74-9e9d-3a4c82ce0973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6d8fdbe59e4e9489b66da367180fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:17:00Z,use_quota=True,user_id='d468c432fcda4510b76fdf94b36d9c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda87df7-13bf-46d2-935f-b7d3d5e08c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda87df7-13bf-46d2-935f-b7d3d5e08c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c739327c-c223-41db-97d3-98d524ea869c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c739327c-c223-41db-97d3-98d524ea869c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a547db5b-2710-4b74-9e9d-3a4c82ce0973', 'volume_name': 'volume-a547db5b-2710-4b74-9e9d-3a4c82ce0973', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:16:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a9c3aa6-6ad7-40c2-ac95-d2b03f757411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:16:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a9c3aa6-6ad7-40c2-ac95-d2b03f757411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff75933d-6249-4a2b-aa2c-e318c268f13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:00 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Volume a547db5b-2710-4b74-9e9d-3a4c82ce0973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a547db5b-2710-4b74-9e9d-3a4c82ce0973', 'volume_size': 1} Sep 06 08:17:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:17:00 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.387s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:00 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:17:00 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager._thread_info {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:17:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread count: 28 {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 08:17:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread info: [<_MainThread(MainThread, started 139985167040640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:17:09 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:UPDATE=37,cinder:SELECT=31,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:17:09 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:INSERT=21,cinder:SELECT=46,cinder:UPDATE=49,cinder:DELETE=5 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:17:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f1f69c91-4ce5-441f-97f3-b15eac356e5e tempest-VolumesActionsTest-1129160947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.026s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:17:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f1f69c91-4ce5-441f-97f3-b15eac356e5e tempest-VolumesActionsTest-1129160947 None] Uploaded volume to glance image-id: 9c1596b8-5419-4b4d-b2b0-cbbd0243d9d8. {{(pid=87307) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 06 08:17:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.386s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:17:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1370057214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a547db5b-2710-4b74-9e9d-3a4c82ce0973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6d8fdbe59e4e9489b66da367180fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:17:00Z,use_quota=True,user_id='d468c432fcda4510b76fdf94b36d9c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:17:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Creating volume a547db5b-2710-4b74-9e9d-3a4c82ce0973 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:17:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:17:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:17:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:17:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:17:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:17:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:17:17 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:17:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a547db5b-2710-4b74-9e9d-3a4c82ce0973 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:17 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a547db5b-2710-4b74-9e9d-3a4c82ce0973 1073741824 Sep 06 08:17:17 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:17 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f1f69c91-4ce5-441f-97f3-b15eac356e5e tempest-VolumesActionsTest-1129160947 None] Copy volume to image completed successfully. Sep 06 08:17:17 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a547db5b-2710-4b74-9e9d-3a4c82ce0973 1073741824" returned: 0 in 0.447s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a547db5b-2710-4b74-9e9d-3a4c82ce0973 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:17 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a547db5b-2710-4b74-9e9d-3a4c82ce0973 Sep 06 08:17:17 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:18 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a547db5b-2710-4b74-9e9d-3a4c82ce0973" returned: 0 in 0.258s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:18 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:17:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:17:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff75933d-6249-4a2b-aa2c-e318c268f13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a547db5b-2710-4b74-9e9d-3a4c82ce0973', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de70bd3-d4d6-4b13-86f9-0ffbc9c8ff4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:18 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Volume volume-a547db5b-2710-4b74-9e9d-3a4c82ce0973 (a547db5b-2710-4b74-9e9d-3a4c82ce0973): created successfully Sep 06 08:17:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de70bd3-d4d6-4b13-86f9-0ffbc9c8ff4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Flow 'volume_create_manager' (67ac53f8-c08b-4e95-b806-c0ff6b7e52bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:17:18 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-14da5e77-575f-418f-82e0-b273f3cd4cc7 tempest-ProjectReaderTests-340275775 None] Created volume successfully. Sep 06 08:17:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:17:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:17:18 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05c526b-8c52-4ff3-88cd-07063bf42f04]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:17:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:18 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 Sep 06 08:17:18 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:18 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8" returned: 0 in 0.356s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:18 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[07df9625-d412-4f36-9bb9-83da42ac2d50]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:17:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:19 devstack sudo[102542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 Sep 06 08:17:19 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:19 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-47a4304c-1c29-4d5c-9d21-1c2a60694e37 tempest-ProjectReaderTests-340275775 None] Acquiring lock "cinder-a547db5b-2710-4b74-9e9d-3a4c82ce0973-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:17:19 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8" returned: 0 in 0.393s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 /opt/stack/data/cinder/conversion/c0f7fb36-cb56-4390-8ff4-21c2b8a702d8.temp_image.cbc9ba6d-ccb9-4400-8529-44692dfbbc304xjqmr2c.img {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:19 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-47a4304c-1c29-4d5c-9d21-1c2a60694e37 tempest-ProjectReaderTests-340275775 None] Lock "cinder-a547db5b-2710-4b74-9e9d-3a4c82ce0973-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:17:19 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 /opt/stack/data/cinder/conversion/c0f7fb36-cb56-4390-8ff4-21c2b8a702d8.temp_image.cbc9ba6d-ccb9-4400-8529-44692dfbbc304xjqmr2c.img Sep 06 08:17:19 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:19 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-47a4304c-1c29-4d5c-9d21-1c2a60694e37 tempest-ProjectReaderTests-340275775 None] Acquiring lock "cinder-quobyte-a547db5b-2710-4b74-9e9d-3a4c82ce0973" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:17:19 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-47a4304c-1c29-4d5c-9d21-1c2a60694e37 tempest-ProjectReaderTests-340275775 None] Lock "cinder-quobyte-a547db5b-2710-4b74-9e9d-3a4c82ce0973" acquired by "delete_volume" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:17:19 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[546e2f25-0715-40de-b03e-b3c8c57f077e]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:17:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-47a4304c-1c29-4d5c-9d21-1c2a60694e37 tempest-ProjectReaderTests-340275775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a547db5b-2710-4b74-9e9d-3a4c82ce0973 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:19 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a547db5b-2710-4b74-9e9d-3a4c82ce0973 Sep 06 08:17:19 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:20 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-47a4304c-1c29-4d5c-9d21-1c2a60694e37 tempest-ProjectReaderTests-340275775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a547db5b-2710-4b74-9e9d-3a4c82ce0973" returned: 0 in 0.868s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-47a4304c-1c29-4d5c-9d21-1c2a60694e37 tempest-ProjectReaderTests-340275775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a547db5b-2710-4b74-9e9d-3a4c82ce0973 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:20 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a547db5b-2710-4b74-9e9d-3a4c82ce0973 Sep 06 08:17:20 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:21 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-47a4304c-1c29-4d5c-9d21-1c2a60694e37 tempest-ProjectReaderTests-340275775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a547db5b-2710-4b74-9e9d-3a4c82ce0973" returned: 0 in 0.904s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:21 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-47a4304c-1c29-4d5c-9d21-1c2a60694e37 tempest-ProjectReaderTests-340275775 None] Lock "cinder-quobyte-a547db5b-2710-4b74-9e9d-3a4c82ce0973" released by "delete_volume" :: held 1.836s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:17:21 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-47a4304c-1c29-4d5c-9d21-1c2a60694e37 tempest-ProjectReaderTests-340275775 None] Created reservations ['63cf2613-9cdc-4557-8e57-aa706dd2db02', 'd57630da-149c-4620-aebb-f337d490cd98', 'f0e0af61-0408-4497-a651-a2625b892210', '9cddfa05-33e1-4dde-83c1-bb2c93cb09d5'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:17:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-47a4304c-1c29-4d5c-9d21-1c2a60694e37 tempest-ProjectReaderTests-340275775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:17:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-47a4304c-1c29-4d5c-9d21-1c2a60694e37 tempest-ProjectReaderTests-340275775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:17:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-47a4304c-1c29-4d5c-9d21-1c2a60694e37 tempest-ProjectReaderTests-340275775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:17:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-47a4304c-1c29-4d5c-9d21-1c2a60694e37 tempest-ProjectReaderTests-340275775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:17:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-47a4304c-1c29-4d5c-9d21-1c2a60694e37 tempest-ProjectReaderTests-340275775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:17:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-47a4304c-1c29-4d5c-9d21-1c2a60694e37 tempest-ProjectReaderTests-340275775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:21 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:17:21 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:22 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-47a4304c-1c29-4d5c-9d21-1c2a60694e37 tempest-ProjectReaderTests-340275775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.740s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:22 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-47a4304c-1c29-4d5c-9d21-1c2a60694e37 tempest-ProjectReaderTests-340275775 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:17:22 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-47a4304c-1c29-4d5c-9d21-1c2a60694e37 tempest-ProjectReaderTests-340275775 None] Deleted volume successfully. Sep 06 08:17:22 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-47a4304c-1c29-4d5c-9d21-1c2a60694e37 tempest-ProjectReaderTests-340275775 None] Lock "cinder-a547db5b-2710-4b74-9e9d-3a4c82ce0973-delete_volume" released by "delete_volume" :: held 3.543s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:17:23 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:17:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Flow 'volume_create_manager' (75ebfaa2-76cc-4142-a43b-cc4983250310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:17:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f07435b-2ef5-4ecd-bd97-01b2ec1efff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f07435b-2ef5-4ecd-bd97-01b2ec1efff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-575143684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc765aa4-4c93-46c0-a539-0dcd77a095ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6d8fdbe59e4e9489b66da367180fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:17:23Z,use_quota=True,user_id='d468c432fcda4510b76fdf94b36d9c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f6f203-c81a-4e15-84c1-65a39c84d669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f6f203-c81a-4e15-84c1-65a39c84d669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e090ae-ae87-4a4d-97f5-8fa8218351e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e090ae-ae87-4a4d-97f5-8fa8218351e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc765aa4-4c93-46c0-a539-0dcd77a095ad', 'volume_name': 'volume-dc765aa4-4c93-46c0-a539-0dcd77a095ad', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa1806a5-5412-4bd6-86ba-482f534f7ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa1806a5-5412-4bd6-86ba-482f534f7ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ee7078-488a-41f5-8922-68b0cfa8e686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:23 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Volume dc765aa4-4c93-46c0-a539-0dcd77a095ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc765aa4-4c93-46c0-a539-0dcd77a095ad', 'volume_size': 1} Sep 06 08:17:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:17:23 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 /opt/stack/data/cinder/conversion/c0f7fb36-cb56-4390-8ff4-21c2b8a702d8.temp_image.cbc9ba6d-ccb9-4400-8529-44692dfbbc304xjqmr2c.img" returned: 0 in 4.530s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:23 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73993ce-f66d-41c8-a127-ce1a551e02a3]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:17:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:23 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 Sep 06 08:17:23 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:24 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8" returned: 0 in 0.523s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:24 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] Image conversion details: src /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8, size 1024.00 MB, duration 4.53 sec, destination /opt/stack/data/cinder/conversion/c0f7fb36-cb56-4390-8ff4-21c2b8a702d8.temp_image.cbc9ba6d-ccb9-4400-8529-44692dfbbc304xjqmr2c.img {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:17:24 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] Converted 1024.00 MB image at 225.99 MB/s Sep 06 08:17:24 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] cbc9ba6d-ccb9-4400-8529-44692dfbbc30 was raw, converting to qcow2 {{(pid=87307) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 06 08:17:24 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[160bf810-613e-4106-b28a-e94e83497a8b]: (4, 'raw') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:17:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c0f7fb36-cb56-4390-8ff4-21c2b8a702d8.temp_image.cbc9ba6d-ccb9-4400-8529-44692dfbbc304xjqmr2c.img {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:24 devstack sudo[102576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c0f7fb36-cb56-4390-8ff4-21c2b8a702d8.temp_image.cbc9ba6d-ccb9-4400-8529-44692dfbbc304xjqmr2c.img Sep 06 08:17:24 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:24 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c0f7fb36-cb56-4390-8ff4-21c2b8a702d8.temp_image.cbc9ba6d-ccb9-4400-8529-44692dfbbc304xjqmr2c.img" returned: 0 in 0.324s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c0f7fb36-cb56-4390-8ff4-21c2b8a702d8.temp_image.cbc9ba6d-ccb9-4400-8529-44692dfbbc304xjqmr2c.img {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:24 devstack sudo[102580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c0f7fb36-cb56-4390-8ff4-21c2b8a702d8.temp_image.cbc9ba6d-ccb9-4400-8529-44692dfbbc304xjqmr2c.img Sep 06 08:17:24 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:25 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c0f7fb36-cb56-4390-8ff4-21c2b8a702d8.temp_image.cbc9ba6d-ccb9-4400-8529-44692dfbbc304xjqmr2c.img" returned: 1 in 0.321s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c0f7fb36-cb56-4390-8ff4-21c2b8a702d8.temp_image.cbc9ba6d-ccb9-4400-8529-44692dfbbc304xjqmr2c.img' failed. Not Retrying. {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 08:17:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c0f7fb36-cb56-4390-8ff4-21c2b8a702d8.temp_image.cbc9ba6d-ccb9-4400-8529-44692dfbbc304xjqmr2c.img /opt/stack/data/cinder/conversion/vol_upload_72_dd5gv {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:25 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c0f7fb36-cb56-4390-8ff4-21c2b8a702d8.temp_image.cbc9ba6d-ccb9-4400-8529-44692dfbbc304xjqmr2c.img /opt/stack/data/cinder/conversion/vol_upload_72_dd5gv Sep 06 08:17:25 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:25 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c0f7fb36-cb56-4390-8ff4-21c2b8a702d8.temp_image.cbc9ba6d-ccb9-4400-8529-44692dfbbc304xjqmr2c.img /opt/stack/data/cinder/conversion/vol_upload_72_dd5gv" returned: 0 in 0.249s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:25 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] Image conversion details: src /opt/stack/data/cinder/conversion/c0f7fb36-cb56-4390-8ff4-21c2b8a702d8.temp_image.cbc9ba6d-ccb9-4400-8529-44692dfbbc304xjqmr2c.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_72_dd5gv {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:17:25 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 06 08:17:25 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe40969b-300f-4813-9f41-83c734c021b8]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:17:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_72_dd5gv {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:25 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_72_dd5gv Sep 06 08:17:25 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:25 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_72_dd5gv" returned: 0 in 0.316s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.296s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:17:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] Uploaded volume to glance image-id: cbc9ba6d-ccb9-4400-8529-44692dfbbc30. {{(pid=87307) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 06 08:17:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.496s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:17:26 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-575143684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc765aa4-4c93-46c0-a539-0dcd77a095ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6d8fdbe59e4e9489b66da367180fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:17:23Z,use_quota=True,user_id='d468c432fcda4510b76fdf94b36d9c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:17:26 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Creating volume dc765aa4-4c93-46c0-a539-0dcd77a095ad {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:17:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:17:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:17:26 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:17:26 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:17:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:17:26 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:17:26 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:17:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dc765aa4-4c93-46c0-a539-0dcd77a095ad 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:26 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dc765aa4-4c93-46c0-a539-0dcd77a095ad 1073741824 Sep 06 08:17:26 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:26 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-5e76d48a-7dae-45d7-969e-a309106423f9 tempest-VolumesActionsTest-1129160947 None] Copy volume to image completed successfully. Sep 06 08:17:27 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dc765aa4-4c93-46c0-a539-0dcd77a095ad 1073741824" returned: 0 in 0.444s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dc765aa4-4c93-46c0-a539-0dcd77a095ad {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:27 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dc765aa4-4c93-46c0-a539-0dcd77a095ad Sep 06 08:17:27 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:27 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dc765aa4-4c93-46c0-a539-0dcd77a095ad" returned: 0 in 0.252s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:17:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:17:27 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ee7078-488a-41f5-8922-68b0cfa8e686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc765aa4-4c93-46c0-a539-0dcd77a095ad', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:27 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68127154-ed80-47e1-95e9-cb7c817e131a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:27 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Volume volume-dc765aa4-4c93-46c0-a539-0dcd77a095ad (dc765aa4-4c93-46c0-a539-0dcd77a095ad): created successfully Sep 06 08:17:27 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68127154-ed80-47e1-95e9-cb7c817e131a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:27 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Flow 'volume_create_manager' (75ebfaa2-76cc-4142-a43b-cc4983250310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:17:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-369aa43f-9fd7-4ddf-a642-916033b42e9b tempest-VolumesActionsTest-1129160947 None] Acquiring lock "cinder-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:17:27 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-2354c294-828a-4985-9aab-001feca5e996 tempest-ProjectReaderTests-340275775 None] Created volume successfully. Sep 06 08:17:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-369aa43f-9fd7-4ddf-a642-916033b42e9b tempest-VolumesActionsTest-1129160947 None] Lock "cinder-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:17:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-369aa43f-9fd7-4ddf-a642-916033b42e9b tempest-VolumesActionsTest-1129160947 None] Acquiring lock "cinder-quobyte-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:17:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-369aa43f-9fd7-4ddf-a642-916033b42e9b tempest-VolumesActionsTest-1129160947 None] Lock "cinder-quobyte-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8" acquired by "delete_volume" :: waited 0.014s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:17:27 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd8ca27-0379-4db9-a2f6-8ee928a63a11]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:17:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-369aa43f-9fd7-4ddf-a642-916033b42e9b tempest-VolumesActionsTest-1129160947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:27 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 Sep 06 08:17:27 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:28 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-369aa43f-9fd7-4ddf-a642-916033b42e9b tempest-VolumesActionsTest-1129160947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8" returned: 0 in 0.353s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-369aa43f-9fd7-4ddf-a642-916033b42e9b tempest-VolumesActionsTest-1129160947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:28 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8 Sep 06 08:17:28 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:28 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-369aa43f-9fd7-4ddf-a642-916033b42e9b tempest-VolumesActionsTest-1129160947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8" returned: 0 in 0.237s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-369aa43f-9fd7-4ddf-a642-916033b42e9b tempest-VolumesActionsTest-1129160947 None] Lock "cinder-quobyte-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8" released by "delete_volume" :: held 0.626s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:17:28 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-369aa43f-9fd7-4ddf-a642-916033b42e9b tempest-VolumesActionsTest-1129160947 None] Created reservations ['3b6c41a5-fd6d-4f85-b3aa-3076a03a1076', 'bcfcae42-6d84-480f-9188-803f9270172c', '052b1c88-f2b2-496e-9075-d4f1a353424e', 'fd97becb-8390-455f-8b7f-ed95e0cfe649'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:17:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-369aa43f-9fd7-4ddf-a642-916033b42e9b tempest-VolumesActionsTest-1129160947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:17:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-369aa43f-9fd7-4ddf-a642-916033b42e9b tempest-VolumesActionsTest-1129160947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:17:28 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-369aa43f-9fd7-4ddf-a642-916033b42e9b tempest-VolumesActionsTest-1129160947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:17:28 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-369aa43f-9fd7-4ddf-a642-916033b42e9b tempest-VolumesActionsTest-1129160947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:17:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-369aa43f-9fd7-4ddf-a642-916033b42e9b tempest-VolumesActionsTest-1129160947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:17:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-369aa43f-9fd7-4ddf-a642-916033b42e9b tempest-VolumesActionsTest-1129160947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e700dc43-6847-43e3-8cc1-d71b6255fc4e tempest-ProjectReaderTests-340275775 None] Acquiring lock "cinder-dc765aa4-4c93-46c0-a539-0dcd77a095ad-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:17:28 devstack sudo[102613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:17:28 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e700dc43-6847-43e3-8cc1-d71b6255fc4e tempest-ProjectReaderTests-340275775 None] Lock "cinder-dc765aa4-4c93-46c0-a539-0dcd77a095ad-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:17:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e700dc43-6847-43e3-8cc1-d71b6255fc4e tempest-ProjectReaderTests-340275775 None] Acquiring lock "cinder-quobyte-dc765aa4-4c93-46c0-a539-0dcd77a095ad" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:17:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e700dc43-6847-43e3-8cc1-d71b6255fc4e tempest-ProjectReaderTests-340275775 None] Lock "cinder-quobyte-dc765aa4-4c93-46c0-a539-0dcd77a095ad" acquired by "delete_volume" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:17:28 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d6f5cf-17fc-4248-b1c6-1358b14dfd5f]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:17:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e700dc43-6847-43e3-8cc1-d71b6255fc4e tempest-ProjectReaderTests-340275775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dc765aa4-4c93-46c0-a539-0dcd77a095ad {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:28 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dc765aa4-4c93-46c0-a539-0dcd77a095ad Sep 06 08:17:28 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:28 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-369aa43f-9fd7-4ddf-a642-916033b42e9b tempest-VolumesActionsTest-1129160947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.248s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:28 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-369aa43f-9fd7-4ddf-a642-916033b42e9b tempest-VolumesActionsTest-1129160947 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:17:28 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-369aa43f-9fd7-4ddf-a642-916033b42e9b tempest-VolumesActionsTest-1129160947 None] Deleted volume successfully. Sep 06 08:17:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-369aa43f-9fd7-4ddf-a642-916033b42e9b tempest-VolumesActionsTest-1129160947 None] Lock "cinder-c0f7fb36-cb56-4390-8ff4-21c2b8a702d8-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:17:28 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e700dc43-6847-43e3-8cc1-d71b6255fc4e tempest-ProjectReaderTests-340275775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dc765aa4-4c93-46c0-a539-0dcd77a095ad" returned: 0 in 0.379s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e700dc43-6847-43e3-8cc1-d71b6255fc4e tempest-ProjectReaderTests-340275775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dc765aa4-4c93-46c0-a539-0dcd77a095ad {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:28 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dc765aa4-4c93-46c0-a539-0dcd77a095ad Sep 06 08:17:28 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:29 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e700dc43-6847-43e3-8cc1-d71b6255fc4e tempest-ProjectReaderTests-340275775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dc765aa4-4c93-46c0-a539-0dcd77a095ad" returned: 0 in 0.244s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e700dc43-6847-43e3-8cc1-d71b6255fc4e tempest-ProjectReaderTests-340275775 None] Lock "cinder-quobyte-dc765aa4-4c93-46c0-a539-0dcd77a095ad" released by "delete_volume" :: held 0.664s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:17:29 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-e700dc43-6847-43e3-8cc1-d71b6255fc4e tempest-ProjectReaderTests-340275775 None] Created reservations ['350606dc-541f-4cea-9d5e-27ad87b9b517', '5f6f33c8-74fe-4a39-8dd0-49cd8bd14f46', 'f717b6b4-e1ce-4a52-ba00-b0da704b86e4', '09c8a5c8-5792-47b1-9265-4f8378bb7d7f'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:17:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e700dc43-6847-43e3-8cc1-d71b6255fc4e tempest-ProjectReaderTests-340275775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:17:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e700dc43-6847-43e3-8cc1-d71b6255fc4e tempest-ProjectReaderTests-340275775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:17:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e700dc43-6847-43e3-8cc1-d71b6255fc4e tempest-ProjectReaderTests-340275775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:17:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e700dc43-6847-43e3-8cc1-d71b6255fc4e tempest-ProjectReaderTests-340275775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:17:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e700dc43-6847-43e3-8cc1-d71b6255fc4e tempest-ProjectReaderTests-340275775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:17:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e700dc43-6847-43e3-8cc1-d71b6255fc4e tempest-ProjectReaderTests-340275775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:29 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:17:29 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:29 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e700dc43-6847-43e3-8cc1-d71b6255fc4e tempest-ProjectReaderTests-340275775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.307s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:29 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-e700dc43-6847-43e3-8cc1-d71b6255fc4e tempest-ProjectReaderTests-340275775 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:17:29 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e700dc43-6847-43e3-8cc1-d71b6255fc4e tempest-ProjectReaderTests-340275775 None] Deleted volume successfully. Sep 06 08:17:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e700dc43-6847-43e3-8cc1-d71b6255fc4e tempest-ProjectReaderTests-340275775 None] Lock "cinder-dc765aa4-4c93-46c0-a539-0dcd77a095ad-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Flow 'volume_create_manager' (5845f6e2-5a2b-4936-a7eb-51dc5c68b747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5670ab-f604-4475-8f10-978e0a19e3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5670ab-f604-4475-8f10-978e0a19e3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-225365161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0cb39c7-f53a-474c-aeef-df24d31584d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6d8fdbe59e4e9489b66da367180fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:17:30Z,use_quota=True,user_id='d468c432fcda4510b76fdf94b36d9c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd45b8b6-edc3-4b01-99b9-d6dcc12bbd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd45b8b6-edc3-4b01-99b9-d6dcc12bbd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd7f142b-f897-49e2-a8b6-adae7b047264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd7f142b-f897-49e2-a8b6-adae7b047264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0cb39c7-f53a-474c-aeef-df24d31584d5', 'volume_name': 'volume-a0cb39c7-f53a-474c-aeef-df24d31584d5', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f1b01a-f3b3-4079-95c1-ce50b5305cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f1b01a-f3b3-4079-95c1-ce50b5305cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1921e24a-a735-4e4c-9ef0-b82b6e9d2a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:30 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Volume a0cb39c7-f53a-474c-aeef-df24d31584d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0cb39c7-f53a-474c-aeef-df24d31584d5', 'volume_size': 1} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-225365161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0cb39c7-f53a-474c-aeef-df24d31584d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6d8fdbe59e4e9489b66da367180fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:17:30Z,use_quota=True,user_id='d468c432fcda4510b76fdf94b36d9c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Creating volume a0cb39c7-f53a-474c-aeef-df24d31584d5 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:17:30 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a0cb39c7-f53a-474c-aeef-df24d31584d5 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:30 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a0cb39c7-f53a-474c-aeef-df24d31584d5 1073741824 Sep 06 08:17:30 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:30 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a0cb39c7-f53a-474c-aeef-df24d31584d5 1073741824" returned: 0 in 0.403s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a0cb39c7-f53a-474c-aeef-df24d31584d5 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:30 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a0cb39c7-f53a-474c-aeef-df24d31584d5 Sep 06 08:17:30 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:30 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a0cb39c7-f53a-474c-aeef-df24d31584d5" returned: 0 in 0.268s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1921e24a-a735-4e4c-9ef0-b82b6e9d2a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0cb39c7-f53a-474c-aeef-df24d31584d5', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6458d78-8a16-4bd5-a7b8-893abaa8c279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:30 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Volume volume-a0cb39c7-f53a-474c-aeef-df24d31584d5 (a0cb39c7-f53a-474c-aeef-df24d31584d5): created successfully Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6458d78-8a16-4bd5-a7b8-893abaa8c279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Flow 'volume_create_manager' (5845f6e2-5a2b-4936-a7eb-51dc5c68b747) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:17:30 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-34c7b449-1d4c-4c27-aca0-dfb2f25396ee tempest-ProjectReaderTests-340275775 None] Created volume successfully. Sep 06 08:17:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c735b36d-f592-4f7c-939c-488b45257c7e tempest-ProjectReaderTests-340275775 None] Acquiring lock "cinder-a0cb39c7-f53a-474c-aeef-df24d31584d5-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:17:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c735b36d-f592-4f7c-939c-488b45257c7e tempest-ProjectReaderTests-340275775 None] Lock "cinder-a0cb39c7-f53a-474c-aeef-df24d31584d5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:17:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c735b36d-f592-4f7c-939c-488b45257c7e tempest-ProjectReaderTests-340275775 None] Acquiring lock "cinder-quobyte-a0cb39c7-f53a-474c-aeef-df24d31584d5" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:17:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c735b36d-f592-4f7c-939c-488b45257c7e tempest-ProjectReaderTests-340275775 None] Lock "cinder-quobyte-a0cb39c7-f53a-474c-aeef-df24d31584d5" acquired by "delete_volume" :: waited 0.019s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:17:31 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[135b05d4-718a-48e7-8150-0cdb41dacaeb]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:17:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c735b36d-f592-4f7c-939c-488b45257c7e tempest-ProjectReaderTests-340275775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a0cb39c7-f53a-474c-aeef-df24d31584d5 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:31 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a0cb39c7-f53a-474c-aeef-df24d31584d5 Sep 06 08:17:31 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:31 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c735b36d-f592-4f7c-939c-488b45257c7e tempest-ProjectReaderTests-340275775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a0cb39c7-f53a-474c-aeef-df24d31584d5" returned: 0 in 0.382s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c735b36d-f592-4f7c-939c-488b45257c7e tempest-ProjectReaderTests-340275775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a0cb39c7-f53a-474c-aeef-df24d31584d5 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:31 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a0cb39c7-f53a-474c-aeef-df24d31584d5 Sep 06 08:17:31 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:31 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c735b36d-f592-4f7c-939c-488b45257c7e tempest-ProjectReaderTests-340275775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a0cb39c7-f53a-474c-aeef-df24d31584d5" returned: 0 in 0.260s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c735b36d-f592-4f7c-939c-488b45257c7e tempest-ProjectReaderTests-340275775 None] Lock "cinder-quobyte-a0cb39c7-f53a-474c-aeef-df24d31584d5" released by "delete_volume" :: held 0.687s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:17:31 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-c735b36d-f592-4f7c-939c-488b45257c7e tempest-ProjectReaderTests-340275775 None] Created reservations ['605ac0cf-225a-442e-8ddd-4383402b30d0', '7d3e9385-ef05-495d-ba4f-5d1851e415e1', '132cfac7-754a-4aaf-b0c8-d8eabdf252b6', '50ec3956-18f0-4e6e-917d-2763db666f7a'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c735b36d-f592-4f7c-939c-488b45257c7e tempest-ProjectReaderTests-340275775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c735b36d-f592-4f7c-939c-488b45257c7e tempest-ProjectReaderTests-340275775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c735b36d-f592-4f7c-939c-488b45257c7e tempest-ProjectReaderTests-340275775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c735b36d-f592-4f7c-939c-488b45257c7e tempest-ProjectReaderTests-340275775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c735b36d-f592-4f7c-939c-488b45257c7e tempest-ProjectReaderTests-340275775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c735b36d-f592-4f7c-939c-488b45257c7e tempest-ProjectReaderTests-340275775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:32 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:17:32 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:32 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c735b36d-f592-4f7c-939c-488b45257c7e tempest-ProjectReaderTests-340275775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.239s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-c735b36d-f592-4f7c-939c-488b45257c7e tempest-ProjectReaderTests-340275775 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:17:32 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-c735b36d-f592-4f7c-939c-488b45257c7e tempest-ProjectReaderTests-340275775 None] Deleted volume successfully. Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c735b36d-f592-4f7c-939c-488b45257c7e tempest-ProjectReaderTests-340275775 None] Lock "cinder-a0cb39c7-f53a-474c-aeef-df24d31584d5-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Flow 'volume_create_manager' (16e43063-00bf-495c-8fa1-2ea055e5b08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef7e8762-4028-4a47-896c-9ec3347c2a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef7e8762-4028-4a47-896c-9ec3347c2a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1701500044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce04bd7-2626-4768-91f9-8638b41cd70a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6d8fdbe59e4e9489b66da367180fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:17:33Z,use_quota=True,user_id='d468c432fcda4510b76fdf94b36d9c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54035058-ad09-41fc-979d-2d3023285756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54035058-ad09-41fc-979d-2d3023285756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef421bd0-4aa4-41b7-9221-f4b78eca8b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef421bd0-4aa4-41b7-9221-f4b78eca8b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bce04bd7-2626-4768-91f9-8638b41cd70a', 'volume_name': 'volume-bce04bd7-2626-4768-91f9-8638b41cd70a', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9eeb7d9-f185-40ee-bf69-2eef39451b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9eeb7d9-f185-40ee-bf69-2eef39451b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d815d79a-760b-49e3-9daf-607abce9d57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:32 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Volume bce04bd7-2626-4768-91f9-8638b41cd70a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bce04bd7-2626-4768-91f9-8638b41cd70a', 'volume_size': 1} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1701500044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce04bd7-2626-4768-91f9-8638b41cd70a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6d8fdbe59e4e9489b66da367180fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:17:33Z,use_quota=True,user_id='d468c432fcda4510b76fdf94b36d9c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Creating volume bce04bd7-2626-4768-91f9-8638b41cd70a {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:17:32 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:17:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bce04bd7-2626-4768-91f9-8638b41cd70a 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:32 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bce04bd7-2626-4768-91f9-8638b41cd70a 1073741824 Sep 06 08:17:32 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:33 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bce04bd7-2626-4768-91f9-8638b41cd70a 1073741824" returned: 0 in 0.430s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bce04bd7-2626-4768-91f9-8638b41cd70a {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:33 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bce04bd7-2626-4768-91f9-8638b41cd70a Sep 06 08:17:33 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:33 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bce04bd7-2626-4768-91f9-8638b41cd70a" returned: 0 in 0.265s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:17:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:17:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d815d79a-760b-49e3-9daf-607abce9d57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bce04bd7-2626-4768-91f9-8638b41cd70a', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e33349c6-4beb-45b9-bbb9-cc18af76792b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:33 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Volume volume-bce04bd7-2626-4768-91f9-8638b41cd70a (bce04bd7-2626-4768-91f9-8638b41cd70a): created successfully Sep 06 08:17:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e33349c6-4beb-45b9-bbb9-cc18af76792b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Flow 'volume_create_manager' (16e43063-00bf-495c-8fa1-2ea055e5b08a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:17:33 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-3c29004f-8997-4e78-b9d6-e4ea3caf4640 tempest-ProjectReaderTests-340275775 None] Created volume successfully. Sep 06 08:17:33 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0df46756-a72b-47d3-ab80-9723afca26ec tempest-ProjectReaderTests-340275775 None] Acquiring lock "cinder-bce04bd7-2626-4768-91f9-8638b41cd70a-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:17:33 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0df46756-a72b-47d3-ab80-9723afca26ec tempest-ProjectReaderTests-340275775 None] Lock "cinder-bce04bd7-2626-4768-91f9-8638b41cd70a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:17:33 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0df46756-a72b-47d3-ab80-9723afca26ec tempest-ProjectReaderTests-340275775 None] Acquiring lock "cinder-quobyte-bce04bd7-2626-4768-91f9-8638b41cd70a" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:17:33 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0df46756-a72b-47d3-ab80-9723afca26ec tempest-ProjectReaderTests-340275775 None] Lock "cinder-quobyte-bce04bd7-2626-4768-91f9-8638b41cd70a" acquired by "delete_volume" :: waited 0.017s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:17:33 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c71d26-f747-41d2-a1ef-2db22326ffba]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:17:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0df46756-a72b-47d3-ab80-9723afca26ec tempest-ProjectReaderTests-340275775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bce04bd7-2626-4768-91f9-8638b41cd70a {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:34 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bce04bd7-2626-4768-91f9-8638b41cd70a Sep 06 08:17:34 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:34 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0df46756-a72b-47d3-ab80-9723afca26ec tempest-ProjectReaderTests-340275775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bce04bd7-2626-4768-91f9-8638b41cd70a" returned: 0 in 0.385s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0df46756-a72b-47d3-ab80-9723afca26ec tempest-ProjectReaderTests-340275775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bce04bd7-2626-4768-91f9-8638b41cd70a {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:34 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bce04bd7-2626-4768-91f9-8638b41cd70a Sep 06 08:17:34 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:34 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0df46756-a72b-47d3-ab80-9723afca26ec tempest-ProjectReaderTests-340275775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bce04bd7-2626-4768-91f9-8638b41cd70a" returned: 0 in 0.259s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:34 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0df46756-a72b-47d3-ab80-9723afca26ec tempest-ProjectReaderTests-340275775 None] Lock "cinder-quobyte-bce04bd7-2626-4768-91f9-8638b41cd70a" released by "delete_volume" :: held 0.686s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:17:34 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-0df46756-a72b-47d3-ab80-9723afca26ec tempest-ProjectReaderTests-340275775 None] Created reservations ['cf23d15b-7b5a-461f-b2de-3750adb9d17b', 'a2adf851-2332-4a9d-abe2-52751a949234', '8cb39abf-d42b-4ded-bd51-bcc5bdb47458', '264b505e-c570-4f0a-a78b-6d7b05409ebd'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:17:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0df46756-a72b-47d3-ab80-9723afca26ec tempest-ProjectReaderTests-340275775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:17:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0df46756-a72b-47d3-ab80-9723afca26ec tempest-ProjectReaderTests-340275775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:17:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0df46756-a72b-47d3-ab80-9723afca26ec tempest-ProjectReaderTests-340275775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:17:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0df46756-a72b-47d3-ab80-9723afca26ec tempest-ProjectReaderTests-340275775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:17:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0df46756-a72b-47d3-ab80-9723afca26ec tempest-ProjectReaderTests-340275775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:17:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0df46756-a72b-47d3-ab80-9723afca26ec tempest-ProjectReaderTests-340275775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:34 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:17:34 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:34 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0df46756-a72b-47d3-ab80-9723afca26ec tempest-ProjectReaderTests-340275775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.259s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:34 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-0df46756-a72b-47d3-ab80-9723afca26ec tempest-ProjectReaderTests-340275775 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:17:34 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-0df46756-a72b-47d3-ab80-9723afca26ec tempest-ProjectReaderTests-340275775 None] Deleted volume successfully. Sep 06 08:17:34 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0df46756-a72b-47d3-ab80-9723afca26ec tempest-ProjectReaderTests-340275775 None] Lock "cinder-bce04bd7-2626-4768-91f9-8638b41cd70a-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Flow 'volume_create_manager' (be176318-0197-44ed-90b5-c8d318719033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a70c41f-01f4-4fdd-8b24-4214d10ab360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a70c41f-01f4-4fdd-8b24-4214d10ab360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1164997435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ac029d-f559-445c-82c8-efc8a2e1629e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470aeb29d9d848189c342a0e0f7d0e8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:17:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:17:37Z,use_quota=True,user_id='226d47c6a3014b2597d08f3d7cf20790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b83cf081-6ed7-40df-a8f3-7416e1641598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b83cf081-6ed7-40df-a8f3-7416e1641598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe99d9ea-f6e2-4860-8a50-b1946e2af8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe99d9ea-f6e2-4860-8a50-b1946e2af8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48ac029d-f559-445c-82c8-efc8a2e1629e', 'volume_name': 'volume-48ac029d-f559-445c-82c8-efc8a2e1629e', 'volume_size': 2}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c729e12-09d4-41a9-8490-6b91fee9a421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c729e12-09d4-41a9-8490-6b91fee9a421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c186cb4-873d-4653-a68d-822b1889e8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:37 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Volume 48ac029d-f559-445c-82c8-efc8a2e1629e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48ac029d-f559-445c-82c8-efc8a2e1629e', 'volume_size': 2} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1164997435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ac029d-f559-445c-82c8-efc8a2e1629e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470aeb29d9d848189c342a0e0f7d0e8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:17:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:17:37Z,use_quota=True,user_id='226d47c6a3014b2597d08f3d7cf20790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Creating volume 48ac029d-f559-445c-82c8-efc8a2e1629e {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:17:37 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-48ac029d-f559-445c-82c8-efc8a2e1629e 2147483648 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:37 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-48ac029d-f559-445c-82c8-efc8a2e1629e 2147483648 Sep 06 08:17:37 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:37 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-48ac029d-f559-445c-82c8-efc8a2e1629e 2147483648" returned: 0 in 0.445s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-48ac029d-f559-445c-82c8-efc8a2e1629e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:37 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-48ac029d-f559-445c-82c8-efc8a2e1629e Sep 06 08:17:37 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:37 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-48ac029d-f559-445c-82c8-efc8a2e1629e" returned: 0 in 0.237s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c186cb4-873d-4653-a68d-822b1889e8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ac029d-f559-445c-82c8-efc8a2e1629e', 'volume_size': 2}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf83893-f939-4db2-a0e4-a94cb7e3a3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:37 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Volume volume-48ac029d-f559-445c-82c8-efc8a2e1629e (48ac029d-f559-445c-82c8-efc8a2e1629e): created successfully Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf83893-f939-4db2-a0e4-a94cb7e3a3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Flow 'volume_create_manager' (be176318-0197-44ed-90b5-c8d318719033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:17:37 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-5461ee8c-532c-485c-9110-a60015c7d7a6 tempest-VolumesCloneNegativeTest-1750380237 None] Created volume successfully. Sep 06 08:17:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7a975dda-9fea-47d8-8cfc-fd33d50ef46c tempest-VolumesCloneNegativeTest-1750380237 None] Acquiring lock "cinder-48ac029d-f559-445c-82c8-efc8a2e1629e-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:17:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7a975dda-9fea-47d8-8cfc-fd33d50ef46c tempest-VolumesCloneNegativeTest-1750380237 None] Lock "cinder-48ac029d-f559-445c-82c8-efc8a2e1629e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:17:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7a975dda-9fea-47d8-8cfc-fd33d50ef46c tempest-VolumesCloneNegativeTest-1750380237 None] Acquiring lock "cinder-quobyte-48ac029d-f559-445c-82c8-efc8a2e1629e" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:17:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7a975dda-9fea-47d8-8cfc-fd33d50ef46c tempest-VolumesCloneNegativeTest-1750380237 None] Lock "cinder-quobyte-48ac029d-f559-445c-82c8-efc8a2e1629e" acquired by "delete_volume" :: waited 0.017s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:17:38 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ea2d8c-be39-4626-ab18-79946022c94d]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:17:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7a975dda-9fea-47d8-8cfc-fd33d50ef46c tempest-VolumesCloneNegativeTest-1750380237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-48ac029d-f559-445c-82c8-efc8a2e1629e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:38 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-48ac029d-f559-445c-82c8-efc8a2e1629e Sep 06 08:17:38 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:38 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7a975dda-9fea-47d8-8cfc-fd33d50ef46c tempest-VolumesCloneNegativeTest-1750380237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-48ac029d-f559-445c-82c8-efc8a2e1629e" returned: 0 in 0.353s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7a975dda-9fea-47d8-8cfc-fd33d50ef46c tempest-VolumesCloneNegativeTest-1750380237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-48ac029d-f559-445c-82c8-efc8a2e1629e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:38 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-48ac029d-f559-445c-82c8-efc8a2e1629e Sep 06 08:17:38 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:38 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7a975dda-9fea-47d8-8cfc-fd33d50ef46c tempest-VolumesCloneNegativeTest-1750380237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-48ac029d-f559-445c-82c8-efc8a2e1629e" returned: 0 in 0.236s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7a975dda-9fea-47d8-8cfc-fd33d50ef46c tempest-VolumesCloneNegativeTest-1750380237 None] Lock "cinder-quobyte-48ac029d-f559-445c-82c8-efc8a2e1629e" released by "delete_volume" :: held 0.629s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:17:39 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-7a975dda-9fea-47d8-8cfc-fd33d50ef46c tempest-VolumesCloneNegativeTest-1750380237 None] Created reservations ['8e2b2597-4eb5-4a4e-95c2-998edc8e4afb', 'ba04999d-f528-4812-a96c-9f85faea468b', 'fdfb7e64-fd04-4eec-a5db-0a08ab5daaa0', '684774d1-6653-4e20-b76e-47ed91938948'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:17:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7a975dda-9fea-47d8-8cfc-fd33d50ef46c tempest-VolumesCloneNegativeTest-1750380237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:17:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7a975dda-9fea-47d8-8cfc-fd33d50ef46c tempest-VolumesCloneNegativeTest-1750380237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:17:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7a975dda-9fea-47d8-8cfc-fd33d50ef46c tempest-VolumesCloneNegativeTest-1750380237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:17:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7a975dda-9fea-47d8-8cfc-fd33d50ef46c tempest-VolumesCloneNegativeTest-1750380237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:17:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7a975dda-9fea-47d8-8cfc-fd33d50ef46c tempest-VolumesCloneNegativeTest-1750380237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:17:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7a975dda-9fea-47d8-8cfc-fd33d50ef46c tempest-VolumesCloneNegativeTest-1750380237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:39 devstack sudo[102687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:17:39 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:39 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7a975dda-9fea-47d8-8cfc-fd33d50ef46c tempest-VolumesCloneNegativeTest-1750380237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.235s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:39 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-7a975dda-9fea-47d8-8cfc-fd33d50ef46c tempest-VolumesCloneNegativeTest-1750380237 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:17:39 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-7a975dda-9fea-47d8-8cfc-fd33d50ef46c tempest-VolumesCloneNegativeTest-1750380237 None] Deleted volume successfully. Sep 06 08:17:39 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-7a975dda-9fea-47d8-8cfc-fd33d50ef46c tempest-VolumesCloneNegativeTest-1750380237 None] Lock "cinder-48ac029d-f559-445c-82c8-efc8a2e1629e-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:17:42 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:17:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Flow 'volume_create_manager' (634ad8be-c693-4fd5-a36a-e2c981d4dbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:17:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fabfdcee-110e-49c8-a4d4-6e617fb30a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fabfdcee-110e-49c8-a4d4-6e617fb30a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-619994410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c424a9-420b-4015-a969-6a6b3a7995d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d13f065f6c49d0a5bc38a9282f7e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:17:43Z,use_quota=True,user_id='e0c64c953b8a4e30be5638292f23d39e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1e025c-3e3f-4799-b5d2-0d0a0ec7b8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1e025c-3e3f-4799-b5d2-0d0a0ec7b8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eea6709-7108-4370-b5c7-063bec4b48d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eea6709-7108-4370-b5c7-063bec4b48d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4c424a9-420b-4015-a969-6a6b3a7995d6', 'volume_name': 'volume-d4c424a9-420b-4015-a969-6a6b3a7995d6', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de727269-4309-4a82-8d7f-0b62c22d5100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de727269-4309-4a82-8d7f-0b62c22d5100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:42 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aac78bb-2a68-45cf-b4dc-544e2521652e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:42 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Volume d4c424a9-420b-4015-a969-6a6b3a7995d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4c424a9-420b-4015-a969-6a6b3a7995d6', 'volume_size': 1} Sep 06 08:17:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:17:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:17:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-619994410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c424a9-420b-4015-a969-6a6b3a7995d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d13f065f6c49d0a5bc38a9282f7e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:17:43Z,use_quota=True,user_id='e0c64c953b8a4e30be5638292f23d39e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:17:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Creating volume d4c424a9-420b-4015-a969-6a6b3a7995d6 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:17:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:17:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:17:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:17:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:17:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:17:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:17:42 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:17:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d4c424a9-420b-4015-a969-6a6b3a7995d6 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:42 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d4c424a9-420b-4015-a969-6a6b3a7995d6 1073741824 Sep 06 08:17:42 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:43 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d4c424a9-420b-4015-a969-6a6b3a7995d6 1073741824" returned: 0 in 0.427s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d4c424a9-420b-4015-a969-6a6b3a7995d6 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:43 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d4c424a9-420b-4015-a969-6a6b3a7995d6 Sep 06 08:17:43 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:43 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d4c424a9-420b-4015-a969-6a6b3a7995d6" returned: 0 in 0.245s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:43 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:17:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:17:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aac78bb-2a68-45cf-b4dc-544e2521652e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4c424a9-420b-4015-a969-6a6b3a7995d6', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53eeac93-c658-4594-80d6-03ab904efe4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:17:43 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Volume volume-d4c424a9-420b-4015-a969-6a6b3a7995d6 (d4c424a9-420b-4015-a969-6a6b3a7995d6): created successfully Sep 06 08:17:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53eeac93-c658-4594-80d6-03ab904efe4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:17:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Flow 'volume_create_manager' (634ad8be-c693-4fd5-a36a-e2c981d4dbfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:17:43 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-274b28c8-86ab-4c30-a22c-20b276b144cb tempest-VolumesNegativeTest-1115673243 None] Created volume successfully. Sep 06 08:17:53 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=43,cinder:INSERT=13,cinder:UPDATE=68,cinder:DELETE=5 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:17:53 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:UPDATE=65,cinder:SELECT=44,cinder:DELETE=7,cinder:INSERT=17 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:17:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-29bed9e5-b468-46b0-838a-1108894e403e tempest-VolumesNegativeTest-1115673243 None] Acquiring lock "cinder-d4c424a9-420b-4015-a969-6a6b3a7995d6-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:17:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-29bed9e5-b468-46b0-838a-1108894e403e tempest-VolumesNegativeTest-1115673243 None] Lock "cinder-d4c424a9-420b-4015-a969-6a6b3a7995d6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:17:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-29bed9e5-b468-46b0-838a-1108894e403e tempest-VolumesNegativeTest-1115673243 None] Acquiring lock "cinder-quobyte-d4c424a9-420b-4015-a969-6a6b3a7995d6" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:17:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-29bed9e5-b468-46b0-838a-1108894e403e tempest-VolumesNegativeTest-1115673243 None] Lock "cinder-quobyte-d4c424a9-420b-4015-a969-6a6b3a7995d6" acquired by "delete_volume" :: waited 0.013s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:17:58 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86b171d-5f63-4cda-846a-c43246fff521]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:17:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-29bed9e5-b468-46b0-838a-1108894e403e tempest-VolumesNegativeTest-1115673243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d4c424a9-420b-4015-a969-6a6b3a7995d6 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:58 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d4c424a9-420b-4015-a969-6a6b3a7995d6 Sep 06 08:17:58 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:59 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-29bed9e5-b468-46b0-838a-1108894e403e tempest-VolumesNegativeTest-1115673243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d4c424a9-420b-4015-a969-6a6b3a7995d6" returned: 0 in 0.351s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-29bed9e5-b468-46b0-838a-1108894e403e tempest-VolumesNegativeTest-1115673243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d4c424a9-420b-4015-a969-6a6b3a7995d6 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:59 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d4c424a9-420b-4015-a969-6a6b3a7995d6 Sep 06 08:17:59 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:59 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-29bed9e5-b468-46b0-838a-1108894e403e tempest-VolumesNegativeTest-1115673243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d4c424a9-420b-4015-a969-6a6b3a7995d6" returned: 0 in 0.237s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-29bed9e5-b468-46b0-838a-1108894e403e tempest-VolumesNegativeTest-1115673243 None] Lock "cinder-quobyte-d4c424a9-420b-4015-a969-6a6b3a7995d6" released by "delete_volume" :: held 0.625s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-29bed9e5-b468-46b0-838a-1108894e403e tempest-VolumesNegativeTest-1115673243 None] Created reservations ['fed36517-1ddb-4cc0-8f28-94bf95a30961', 'bcc7055b-e1c0-44c7-a67f-f33622fb455e', 'd5ed36a4-8c34-4334-a454-c331dae22c4d', '8761c10d-ba9e-4f39-ab75-e4861750dc9b'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-29bed9e5-b468-46b0-838a-1108894e403e tempest-VolumesNegativeTest-1115673243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-29bed9e5-b468-46b0-838a-1108894e403e tempest-VolumesNegativeTest-1115673243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-29bed9e5-b468-46b0-838a-1108894e403e tempest-VolumesNegativeTest-1115673243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-29bed9e5-b468-46b0-838a-1108894e403e tempest-VolumesNegativeTest-1115673243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-29bed9e5-b468-46b0-838a-1108894e403e tempest-VolumesNegativeTest-1115673243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-29bed9e5-b468-46b0-838a-1108894e403e tempest-VolumesNegativeTest-1115673243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:59 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:17:59 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:17:59 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:17:59 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:17:59 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-29bed9e5-b468-46b0-838a-1108894e403e tempest-VolumesNegativeTest-1115673243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.249s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-29bed9e5-b468-46b0-838a-1108894e403e tempest-VolumesNegativeTest-1115673243 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:17:59 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-29bed9e5-b468-46b0-838a-1108894e403e tempest-VolumesNegativeTest-1115673243 None] Deleted volume successfully. Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-29bed9e5-b468-46b0-838a-1108894e403e tempest-VolumesNegativeTest-1115673243 None] Lock "cinder-d4c424a9-420b-4015-a969-6a6b3a7995d6-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:17:59 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.255s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager._thread_info {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread count: 28 {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 08:17:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread info: [<_MainThread(MainThread, started 139985167040640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:18:09 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:UPDATE=10,cinder:SELECT=6,cinder:INSERT=1 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:18:09 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Flow 'volume_create_manager' (a8e77c46-a408-44f0-a664-7155f82cc3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b201e92-0abc-49c6-aefb-b1d16696d6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b201e92-0abc-49c6-aefb-b1d16696d6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1864719438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c0ddfab-6f61-4994-aa7b-cb780503c29b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295ac91aad4b43aa94ccee441f36c9f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:18:20Z,use_quota=True,user_id='611bf10c6d9e487bad13207886d2348f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75376011-4ceb-459d-aa14-f55d766e1eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75376011-4ceb-459d-aa14-f55d766e1eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5de5ae-f507-410a-b8d6-adc3a574ef5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5de5ae-f507-410a-b8d6-adc3a574ef5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c0ddfab-6f61-4994-aa7b-cb780503c29b', 'volume_name': 'volume-9c0ddfab-6f61-4994-aa7b-cb780503c29b', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1fad19-156e-4d93-9ac4-5f6393f4a50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1fad19-156e-4d93-9ac4-5f6393f4a50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f880289c-0ae2-4211-8b96-7a3ab0fec471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:18:20 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Volume 9c0ddfab-6f61-4994-aa7b-cb780503c29b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c0ddfab-6f61-4994-aa7b-cb780503c29b', 'volume_size': 1} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1864719438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c0ddfab-6f61-4994-aa7b-cb780503c29b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295ac91aad4b43aa94ccee441f36c9f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:18:20Z,use_quota=True,user_id='611bf10c6d9e487bad13207886d2348f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Creating volume 9c0ddfab-6f61-4994-aa7b-cb780503c29b {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:18:20 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9c0ddfab-6f61-4994-aa7b-cb780503c29b 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:18:20 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9c0ddfab-6f61-4994-aa7b-cb780503c29b 1073741824 Sep 06 08:18:20 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Flow 'volume_create_manager' (f413999d-7363-4ead-b4e6-11fb1de998ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f01092d-ce54-48e3-b09f-be36b56f0248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f01092d-ce54-48e3-b09f-be36b56f0248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1354784958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295ac91aad4b43aa94ccee441f36c9f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:18:21Z,use_quota=True,user_id='611bf10c6d9e487bad13207886d2348f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (598c55de-4df8-45bd-9b05-12bb9642ca2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (598c55de-4df8-45bd-9b05-12bb9642ca2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d270f9-a230-4bcf-acd8-1fcedc88bc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d270f9-a230-4bcf-acd8-1fcedc88bc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1', 'volume_name': 'volume-07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa575c07-76d3-40bd-b222-76e7948b0322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa575c07-76d3-40bd-b222-76e7948b0322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69dcbceb-43d8-41d2-b448-a20ede4d796a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:18:20 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Volume 07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1', 'volume_size': 1} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:18:20 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9c0ddfab-6f61-4994-aa7b-cb780503c29b 1073741824" returned: 0 in 0.499s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:18:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9c0ddfab-6f61-4994-aa7b-cb780503c29b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:18:21 devstack sudo[102884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9c0ddfab-6f61-4994-aa7b-cb780503c29b Sep 06 08:18:21 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:18:21 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root Sep 06 08:18:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9c0ddfab-6f61-4994-aa7b-cb780503c29b" returned: 0 in 0.273s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:18:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:18:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:18:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.474s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:18:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1354784958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295ac91aad4b43aa94ccee441f36c9f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:18:21Z,use_quota=True,user_id='611bf10c6d9e487bad13207886d2348f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:18:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Creating volume 07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:18:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:18:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:18:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:18:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:18:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:18:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:18:21 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:18:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:18:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f880289c-0ae2-4211-8b96-7a3ab0fec471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c0ddfab-6f61-4994-aa7b-cb780503c29b', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:18:21 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1 1073741824 Sep 06 08:18:21 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:18:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3496e269-587e-4ea4-95df-1bfd4de1fda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:18:21 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Volume volume-9c0ddfab-6f61-4994-aa7b-cb780503c29b (9c0ddfab-6f61-4994-aa7b-cb780503c29b): created successfully Sep 06 08:18:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3496e269-587e-4ea4-95df-1bfd4de1fda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:18:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Flow 'volume_create_manager' (a8e77c46-a408-44f0-a664-7155f82cc3e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:18:21 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-3d5b1ce0-e30f-4315-885b-2e4f2aaf5444 tempest-TestServerVolumeAttachmentScenario-67643620 None] Created volume successfully. Sep 06 08:18:21 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Sep 06 08:18:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1 1073741824" returned: 0 in 0.444s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:18:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:18:21 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1 Sep 06 08:18:21 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:18:21 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Sep 06 08:18:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1" returned: 0 in 0.252s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:18:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:18:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:18:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69dcbceb-43d8-41d2-b448-a20ede4d796a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:18:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ac67ed-7aaf-4825-a8da-fef81de61e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:18:22 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Volume volume-07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1 (07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1): created successfully Sep 06 08:18:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ac67ed-7aaf-4825-a8da-fef81de61e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:18:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Flow 'volume_create_manager' (f413999d-7363-4ead-b4e6-11fb1de998ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:18:22 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-d4aee342-7da5-4841-a8e0-1fbc1e7f9d17 tempest-TestServerVolumeAttachmentScenario-67643620 None] Created volume successfully. Sep 06 08:18:32 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:18:32 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:UPDATE=9,cinder:SELECT=2,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:18:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-9b5de0d6-b5db-4813-b01b-fcba86cfc8fe req-4fc555a7-515d-4852-b97c-cf17a7aeedc0 tempest-TestServerVolumeAttachmentScenario-67643620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:18:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-9b5de0d6-b5db-4813-b01b-fcba86cfc8fe req-4fc555a7-515d-4852-b97c-cf17a7aeedc0 tempest-TestServerVolumeAttachmentScenario-67643620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:18:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-9b5de0d6-b5db-4813-b01b-fcba86cfc8fe req-4fc555a7-515d-4852-b97c-cf17a7aeedc0 tempest-TestServerVolumeAttachmentScenario-67643620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:18:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-9b5de0d6-b5db-4813-b01b-fcba86cfc8fe req-4fc555a7-515d-4852-b97c-cf17a7aeedc0 tempest-TestServerVolumeAttachmentScenario-67643620 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0', 'name': 'volume-9c0ddfab-6f61-4994-aa7b-cb780503c29b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c64183f0-314a-4f86-a333-48e38ac64d8e', 'enforce_multipath': True} {{(pid=87307) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 08:18:51 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-9b5de0d6-b5db-4813-b01b-fcba86cfc8fe req-4fc555a7-515d-4852-b97c-cf17a7aeedc0 tempest-TestServerVolumeAttachmentScenario-67643620 None] attachment_update completed successfully. Sep 06 08:18:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-e9dd012e-3006-45a5-9031-020187874646 req-8eadd32b-3989-449b-90e6-dcaf2bae4b22 tempest-TestServerVolumeAttachmentScenario-67643620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:18:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-e9dd012e-3006-45a5-9031-020187874646 req-8eadd32b-3989-449b-90e6-dcaf2bae4b22 tempest-TestServerVolumeAttachmentScenario-67643620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:18:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-e9dd012e-3006-45a5-9031-020187874646 req-8eadd32b-3989-449b-90e6-dcaf2bae4b22 tempest-TestServerVolumeAttachmentScenario-67643620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:18:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-e9dd012e-3006-45a5-9031-020187874646 req-8eadd32b-3989-449b-90e6-dcaf2bae4b22 tempest-TestServerVolumeAttachmentScenario-67643620 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0', 'name': 'volume-07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93ce6201-d16d-485b-b47b-38f73c4e03f9', 'enforce_multipath': True} {{(pid=87307) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 08:18:55 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-e9dd012e-3006-45a5-9031-020187874646 req-8eadd32b-3989-449b-90e6-dcaf2bae4b22 tempest-TestServerVolumeAttachmentScenario-67643620 None] attachment_update completed successfully. Sep 06 08:18:56 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-211399d0-46af-4263-ae51-196cb5eced69 req-f9aa84fc-54c9-4378-9bf7-42c2ad097900 tempest-TestServerVolumeAttachmentScenario-67643620 None] Terminate volume connection completed successfully. Sep 06 08:18:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-211399d0-46af-4263-ae51-196cb5eced69 req-f9aa84fc-54c9-4378-9bf7-42c2ad097900 tempest-TestServerVolumeAttachmentScenario-67643620 None] Deleting attachment 93ce6201-d16d-485b-b47b-38f73c4e03f9. {{(pid=87307) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 08:18:57 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-d7aeec30-903f-4665-9cd1-decac6121157 req-f523a201-5045-48cb-ac89-82e90a05e1d7 tempest-TestServerVolumeAttachmentScenario-67643620 None] Terminate volume connection completed successfully. Sep 06 08:18:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-d7aeec30-903f-4665-9cd1-decac6121157 req-f523a201-5045-48cb-ac89-82e90a05e1d7 tempest-TestServerVolumeAttachmentScenario-67643620 None] Deleting attachment c64183f0-314a-4f86-a333-48e38ac64d8e. {{(pid=87307) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 08:18:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:18:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:18:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:18:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:18:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:18:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:18:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:18:59 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:18:59 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:18:59 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Sep 06 08:18:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.296s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:18:59 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:18:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager._thread_info {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:18:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread count: 28 {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 08:18:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread info: [<_MainThread(MainThread, started 139985167040640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:19:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-cbbaae6a-4d74-4f7f-a048-e8f1e5b28d36 tempest-TestServerVolumeAttachmentScenario-67643620 None] Acquiring lock "cinder-07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:19:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-cbbaae6a-4d74-4f7f-a048-e8f1e5b28d36 tempest-TestServerVolumeAttachmentScenario-67643620 None] Lock "cinder-07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:19:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-cbbaae6a-4d74-4f7f-a048-e8f1e5b28d36 tempest-TestServerVolumeAttachmentScenario-67643620 None] Acquiring lock "cinder-quobyte-07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:19:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-cbbaae6a-4d74-4f7f-a048-e8f1e5b28d36 tempest-TestServerVolumeAttachmentScenario-67643620 None] Lock "cinder-quobyte-07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1" acquired by "delete_volume" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:19:02 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c4c7c1-07da-4303-b79f-e7029852c79b]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:19:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cbbaae6a-4d74-4f7f-a048-e8f1e5b28d36 tempest-TestServerVolumeAttachmentScenario-67643620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:19:02 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1 Sep 06 08:19:02 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:19:02 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Sep 06 08:19:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cbbaae6a-4d74-4f7f-a048-e8f1e5b28d36 tempest-TestServerVolumeAttachmentScenario-67643620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1" returned: 0 in 0.345s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:19:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cbbaae6a-4d74-4f7f-a048-e8f1e5b28d36 tempest-TestServerVolumeAttachmentScenario-67643620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:19:02 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1 Sep 06 08:19:02 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:19:03 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Sep 06 08:19:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cbbaae6a-4d74-4f7f-a048-e8f1e5b28d36 tempest-TestServerVolumeAttachmentScenario-67643620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1" returned: 0 in 0.239s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:19:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-cbbaae6a-4d74-4f7f-a048-e8f1e5b28d36 tempest-TestServerVolumeAttachmentScenario-67643620 None] Lock "cinder-quobyte-07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1" released by "delete_volume" :: held 0.622s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:19:03 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-cbbaae6a-4d74-4f7f-a048-e8f1e5b28d36 tempest-TestServerVolumeAttachmentScenario-67643620 None] Created reservations ['d28d8e01-dcb6-4867-84fc-0e4ea0acf9dc', 'b60f1402-880d-4e81-b85e-f563ba299c61', 'c1168151-9552-49f6-833c-624b24796f29', 'd7cd609e-3cbe-4781-871a-ea04e8b74a81'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:19:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cbbaae6a-4d74-4f7f-a048-e8f1e5b28d36 tempest-TestServerVolumeAttachmentScenario-67643620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:19:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cbbaae6a-4d74-4f7f-a048-e8f1e5b28d36 tempest-TestServerVolumeAttachmentScenario-67643620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:19:03 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cbbaae6a-4d74-4f7f-a048-e8f1e5b28d36 tempest-TestServerVolumeAttachmentScenario-67643620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:19:03 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cbbaae6a-4d74-4f7f-a048-e8f1e5b28d36 tempest-TestServerVolumeAttachmentScenario-67643620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:19:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cbbaae6a-4d74-4f7f-a048-e8f1e5b28d36 tempest-TestServerVolumeAttachmentScenario-67643620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:19:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cbbaae6a-4d74-4f7f-a048-e8f1e5b28d36 tempest-TestServerVolumeAttachmentScenario-67643620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:19:03 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:19:03 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:19:03 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Sep 06 08:19:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cbbaae6a-4d74-4f7f-a048-e8f1e5b28d36 tempest-TestServerVolumeAttachmentScenario-67643620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.235s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:19:03 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-cbbaae6a-4d74-4f7f-a048-e8f1e5b28d36 tempest-TestServerVolumeAttachmentScenario-67643620 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:19:03 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-cbbaae6a-4d74-4f7f-a048-e8f1e5b28d36 tempest-TestServerVolumeAttachmentScenario-67643620 None] Deleted volume successfully. Sep 06 08:19:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-cbbaae6a-4d74-4f7f-a048-e8f1e5b28d36 tempest-TestServerVolumeAttachmentScenario-67643620 None] Lock "cinder-07bdf9c9-70c4-4129-9f0f-58f67a5ccdc1-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:19:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e75a1f71-55fe-4957-84ac-8ca37e261876 tempest-TestServerVolumeAttachmentScenario-67643620 None] Acquiring lock "cinder-9c0ddfab-6f61-4994-aa7b-cb780503c29b-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:19:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e75a1f71-55fe-4957-84ac-8ca37e261876 tempest-TestServerVolumeAttachmentScenario-67643620 None] Lock "cinder-9c0ddfab-6f61-4994-aa7b-cb780503c29b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:19:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e75a1f71-55fe-4957-84ac-8ca37e261876 tempest-TestServerVolumeAttachmentScenario-67643620 None] Acquiring lock "cinder-quobyte-9c0ddfab-6f61-4994-aa7b-cb780503c29b" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:19:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e75a1f71-55fe-4957-84ac-8ca37e261876 tempest-TestServerVolumeAttachmentScenario-67643620 None] Lock "cinder-quobyte-9c0ddfab-6f61-4994-aa7b-cb780503c29b" acquired by "delete_volume" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:19:03 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[76834bd3-d85f-489a-87f1-49bde3ecd641]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:19:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e75a1f71-55fe-4957-84ac-8ca37e261876 tempest-TestServerVolumeAttachmentScenario-67643620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9c0ddfab-6f61-4994-aa7b-cb780503c29b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:19:03 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9c0ddfab-6f61-4994-aa7b-cb780503c29b Sep 06 08:19:03 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:19:03 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Sep 06 08:19:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e75a1f71-55fe-4957-84ac-8ca37e261876 tempest-TestServerVolumeAttachmentScenario-67643620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9c0ddfab-6f61-4994-aa7b-cb780503c29b" returned: 0 in 0.362s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:19:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e75a1f71-55fe-4957-84ac-8ca37e261876 tempest-TestServerVolumeAttachmentScenario-67643620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9c0ddfab-6f61-4994-aa7b-cb780503c29b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:19:03 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9c0ddfab-6f61-4994-aa7b-cb780503c29b Sep 06 08:19:03 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:19:04 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Sep 06 08:19:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e75a1f71-55fe-4957-84ac-8ca37e261876 tempest-TestServerVolumeAttachmentScenario-67643620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9c0ddfab-6f61-4994-aa7b-cb780503c29b" returned: 0 in 0.263s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:19:04 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e75a1f71-55fe-4957-84ac-8ca37e261876 tempest-TestServerVolumeAttachmentScenario-67643620 None] Lock "cinder-quobyte-9c0ddfab-6f61-4994-aa7b-cb780503c29b" released by "delete_volume" :: held 0.664s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:19:04 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-e75a1f71-55fe-4957-84ac-8ca37e261876 tempest-TestServerVolumeAttachmentScenario-67643620 None] Created reservations ['58f3417d-a091-4491-a626-a7ca27a4c173', 'cda7914c-b8f0-44b4-b8bb-2d0839292655', 'a6d3e872-7482-4a0e-9aaa-dba855b166fc', '629e8598-766d-438e-9a00-1f9c491d33d5'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:19:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e75a1f71-55fe-4957-84ac-8ca37e261876 tempest-TestServerVolumeAttachmentScenario-67643620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:19:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e75a1f71-55fe-4957-84ac-8ca37e261876 tempest-TestServerVolumeAttachmentScenario-67643620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:19:04 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e75a1f71-55fe-4957-84ac-8ca37e261876 tempest-TestServerVolumeAttachmentScenario-67643620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:19:04 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e75a1f71-55fe-4957-84ac-8ca37e261876 tempest-TestServerVolumeAttachmentScenario-67643620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:19:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e75a1f71-55fe-4957-84ac-8ca37e261876 tempest-TestServerVolumeAttachmentScenario-67643620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:19:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e75a1f71-55fe-4957-84ac-8ca37e261876 tempest-TestServerVolumeAttachmentScenario-67643620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:19:04 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:19:04 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:19:04 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Sep 06 08:19:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e75a1f71-55fe-4957-84ac-8ca37e261876 tempest-TestServerVolumeAttachmentScenario-67643620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.263s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:19:04 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-e75a1f71-55fe-4957-84ac-8ca37e261876 tempest-TestServerVolumeAttachmentScenario-67643620 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:19:04 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e75a1f71-55fe-4957-84ac-8ca37e261876 tempest-TestServerVolumeAttachmentScenario-67643620 None] Deleted volume successfully. Sep 06 08:19:04 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e75a1f71-55fe-4957-84ac-8ca37e261876 tempest-TestServerVolumeAttachmentScenario-67643620 None] Lock "cinder-9c0ddfab-6f61-4994-aa7b-cb780503c29b-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:19:14 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=26,cinder:UPDATE=17,cinder:INSERT=5 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:19:14 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=24,cinder:UPDATE=21,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:19:31 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:19:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Flow 'volume_create_manager' (f8d2fe4a-8d2b-43a7-90da-214179382e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:19:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27636124-4ac4-458a-bce8-493ecee35290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:19:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27636124-4ac4-458a-bce8-493ecee35290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-726119344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fbc8094-488c-40b5-967c-b6fca3aa7753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f74b5b119f4ba9bfac28c6f7ce76f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:19:31Z,use_quota=True,user_id='6055094bba2441feb7bb0d67500b7307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:19:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f13824-0c90-47be-8f32-b9deaf2a6ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:19:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f13824-0c90-47be-8f32-b9deaf2a6ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:19:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b94a87-09ca-4093-883f-205e16e3136d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:19:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b94a87-09ca-4093-883f-205e16e3136d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fbc8094-488c-40b5-967c-b6fca3aa7753', 'volume_name': 'volume-2fbc8094-488c-40b5-967c-b6fca3aa7753', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:19:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f16f20-4000-4e62-9a2b-a64889544240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:19:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f16f20-4000-4e62-9a2b-a64889544240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:19:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fdd52fa-6638-457e-aca9-4d2bba071642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:19:31 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Volume 2fbc8094-488c-40b5-967c-b6fca3aa7753: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fbc8094-488c-40b5-967c-b6fca3aa7753', 'volume_size': 1} Sep 06 08:19:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:19:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:19:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-726119344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fbc8094-488c-40b5-967c-b6fca3aa7753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f74b5b119f4ba9bfac28c6f7ce76f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:19:31Z,use_quota=True,user_id='6055094bba2441feb7bb0d67500b7307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:19:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Creating volume 2fbc8094-488c-40b5-967c-b6fca3aa7753 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:19:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:19:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:19:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:19:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:19:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:19:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:19:31 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:19:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:19:31 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753 1073741824 Sep 06 08:19:31 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:19:31 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Sep 06 08:19:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753 1073741824" returned: 0 in 0.400s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:19:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:19:32 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753 Sep 06 08:19:32 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:19:32 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Sep 06 08:19:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753" returned: 0 in 0.240s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:19:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:19:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:19:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fdd52fa-6638-457e-aca9-4d2bba071642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fbc8094-488c-40b5-967c-b6fca3aa7753', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:19:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c85601a-ad8c-48e1-aa51-a0045e942017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:19:32 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Volume volume-2fbc8094-488c-40b5-967c-b6fca3aa7753 (2fbc8094-488c-40b5-967c-b6fca3aa7753): created successfully Sep 06 08:19:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c85601a-ad8c-48e1-aa51-a0045e942017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:19:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Flow 'volume_create_manager' (f8d2fe4a-8d2b-43a7-90da-214179382e3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:19:32 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-cfd66df2-f59e-4105-b5de-1d444758a008 tempest-TestImageHashVerification-293207062 None] Created volume successfully. Sep 06 08:19:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ad5f27da-adf4-4a8e-9ca9-c734a95ace63 tempest-TestImageHashVerification-293207062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:19:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ad5f27da-adf4-4a8e-9ca9-c734a95ace63 tempest-TestImageHashVerification-293207062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:19:33 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3792e4-84ef-4a98-bddb-592582bd7eeb]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:19:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ad5f27da-adf4-4a8e-9ca9-c734a95ace63 tempest-TestImageHashVerification-293207062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:19:33 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753 Sep 06 08:19:33 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:19:33 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Sep 06 08:19:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ad5f27da-adf4-4a8e-9ca9-c734a95ace63 tempest-TestImageHashVerification-293207062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753" returned: 0 in 0.346s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:19:33 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[42897602-d9b3-44bd-8534-25b7302eadbd]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:19:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ad5f27da-adf4-4a8e-9ca9-c734a95ace63 tempest-TestImageHashVerification-293207062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:19:33 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753 Sep 06 08:19:33 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:19:33 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Sep 06 08:19:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ad5f27da-adf4-4a8e-9ca9-c734a95ace63 tempest-TestImageHashVerification-293207062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753" returned: 0 in 0.351s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:19:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ad5f27da-adf4-4a8e-9ca9-c734a95ace63 tempest-TestImageHashVerification-293207062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753 /opt/stack/data/cinder/conversion/2fbc8094-488c-40b5-967c-b6fca3aa7753.temp_image.118c67e1-00f4-42d6-821d-52c020dc469fobgie8ma.img {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:19:34 devstack sudo[103567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753 /opt/stack/data/cinder/conversion/2fbc8094-488c-40b5-967c-b6fca3aa7753.temp_image.118c67e1-00f4-42d6-821d-52c020dc469fobgie8ma.img Sep 06 08:19:34 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:19:37 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root Sep 06 08:19:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ad5f27da-adf4-4a8e-9ca9-c734a95ace63 tempest-TestImageHashVerification-293207062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753 /opt/stack/data/cinder/conversion/2fbc8094-488c-40b5-967c-b6fca3aa7753.temp_image.118c67e1-00f4-42d6-821d-52c020dc469fobgie8ma.img" returned: 0 in 3.959s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:19:37 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d01ba97-0e0e-429e-9ca4-e4eea486d497]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:19:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ad5f27da-adf4-4a8e-9ca9-c734a95ace63 tempest-TestImageHashVerification-293207062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:19:38 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753 Sep 06 08:19:38 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:19:38 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Sep 06 08:19:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ad5f27da-adf4-4a8e-9ca9-c734a95ace63 tempest-TestImageHashVerification-293207062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753" returned: 0 in 0.516s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:19:38 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-ad5f27da-adf4-4a8e-9ca9-c734a95ace63 tempest-TestImageHashVerification-293207062 None] Image conversion details: src /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753, size 1024.00 MB, duration 3.96 sec, destination /opt/stack/data/cinder/conversion/2fbc8094-488c-40b5-967c-b6fca3aa7753.temp_image.118c67e1-00f4-42d6-821d-52c020dc469fobgie8ma.img {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:19:38 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-ad5f27da-adf4-4a8e-9ca9-c734a95ace63 tempest-TestImageHashVerification-293207062 None] Converted 1024.00 MB image at 258.54 MB/s Sep 06 08:19:38 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-ad5f27da-adf4-4a8e-9ca9-c734a95ace63 tempest-TestImageHashVerification-293207062 None] 118c67e1-00f4-42d6-821d-52c020dc469f was raw, no need to convert to raw {{(pid=87307) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 06 08:19:42 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:19:48 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:UPDATE=3,cinder:SELECT=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:19:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ad5f27da-adf4-4a8e-9ca9-c734a95ace63 tempest-TestImageHashVerification-293207062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 23.872s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:19:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ad5f27da-adf4-4a8e-9ca9-c734a95ace63 tempest-TestImageHashVerification-293207062 None] Uploaded volume to glance image-id: 118c67e1-00f4-42d6-821d-52c020dc469f. {{(pid=87307) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 06 08:19:57 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-ad5f27da-adf4-4a8e-9ca9-c734a95ace63 tempest-TestImageHashVerification-293207062 None] Copy volume to image completed successfully. Sep 06 08:19:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-df446499-ae30-4da9-aa29-cb2477cebef0 tempest-TestImageHashVerification-293207062 None] Acquiring lock "cinder-2fbc8094-488c-40b5-967c-b6fca3aa7753-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:19:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-df446499-ae30-4da9-aa29-cb2477cebef0 tempest-TestImageHashVerification-293207062 None] Lock "cinder-2fbc8094-488c-40b5-967c-b6fca3aa7753-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:19:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-df446499-ae30-4da9-aa29-cb2477cebef0 tempest-TestImageHashVerification-293207062 None] Acquiring lock "cinder-quobyte-2fbc8094-488c-40b5-967c-b6fca3aa7753" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:19:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-df446499-ae30-4da9-aa29-cb2477cebef0 tempest-TestImageHashVerification-293207062 None] Lock "cinder-quobyte-2fbc8094-488c-40b5-967c-b6fca3aa7753" acquired by "delete_volume" :: waited 0.016s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:19:58 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf8d702-a49b-49a7-9ad1-c44a8e451687]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:19:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-df446499-ae30-4da9-aa29-cb2477cebef0 tempest-TestImageHashVerification-293207062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:19:58 devstack sudo[103627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753 Sep 06 08:19:58 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:19:59 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-df446499-ae30-4da9-aa29-cb2477cebef0 tempest-TestImageHashVerification-293207062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753" returned: 0 in 0.356s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-df446499-ae30-4da9-aa29-cb2477cebef0 tempest-TestImageHashVerification-293207062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:19:59 devstack sudo[103632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753 Sep 06 08:19:59 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:19:59 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-df446499-ae30-4da9-aa29-cb2477cebef0 tempest-TestImageHashVerification-293207062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2fbc8094-488c-40b5-967c-b6fca3aa7753" returned: 0 in 0.239s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-df446499-ae30-4da9-aa29-cb2477cebef0 tempest-TestImageHashVerification-293207062 None] Lock "cinder-quobyte-2fbc8094-488c-40b5-967c-b6fca3aa7753" released by "delete_volume" :: held 0.630s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-df446499-ae30-4da9-aa29-cb2477cebef0 tempest-TestImageHashVerification-293207062 None] Created reservations ['c44ac695-27dc-46b9-ac51-84c2370ada5d', 'bb8c7352-c405-472f-a032-5974cc2f980d', '8edca527-3ce8-445c-9e2a-f7a804ccc4e0', 'f150e2c3-a793-4e84-8ba3-e5273afe2fe0'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-df446499-ae30-4da9-aa29-cb2477cebef0 tempest-TestImageHashVerification-293207062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-df446499-ae30-4da9-aa29-cb2477cebef0 tempest-TestImageHashVerification-293207062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-df446499-ae30-4da9-aa29-cb2477cebef0 tempest-TestImageHashVerification-293207062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-df446499-ae30-4da9-aa29-cb2477cebef0 tempest-TestImageHashVerification-293207062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-df446499-ae30-4da9-aa29-cb2477cebef0 tempest-TestImageHashVerification-293207062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-df446499-ae30-4da9-aa29-cb2477cebef0 tempest-TestImageHashVerification-293207062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:19:59 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:19:59 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:19:59 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-df446499-ae30-4da9-aa29-cb2477cebef0 tempest-TestImageHashVerification-293207062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.257s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-df446499-ae30-4da9-aa29-cb2477cebef0 tempest-TestImageHashVerification-293207062 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:19:59 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-df446499-ae30-4da9-aa29-cb2477cebef0 tempest-TestImageHashVerification-293207062 None] Deleted volume successfully. Sep 06 08:19:59 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:19:59 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-df446499-ae30-4da9-aa29-cb2477cebef0 tempest-TestImageHashVerification-293207062 None] Lock "cinder-2fbc8094-488c-40b5-967c-b6fca3aa7753-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:19:59 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.272s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager._thread_info {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread count: 28 {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 08:19:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread info: [<_MainThread(MainThread, started 139985167040640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:20:09 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=5,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:20:09 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:20:31 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:20:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Flow 'volume_create_manager' (53e912f4-cfa8-405b-9124-cd77866ca753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:20:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da3432f0-c7f4-4fcf-a55e-c92575a996db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:20:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da3432f0-c7f4-4fcf-a55e-c92575a996db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1925717124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed39e8e-f50c-4a66-9db1-853e790110bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155846ae7ced4ca99b72b4b380927df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:20:31Z,use_quota=True,user_id='108f4b424c5e4ad1a3efc25eeb85fecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:20:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (237cb782-69e6-4a10-915a-0bea2ae36eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:20:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (237cb782-69e6-4a10-915a-0bea2ae36eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:20:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d8c5f0-6d83-4552-8fad-53d20643b7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:20:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d8c5f0-6d83-4552-8fad-53d20643b7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed39e8e-f50c-4a66-9db1-853e790110bd', 'volume_name': 'volume-eed39e8e-f50c-4a66-9db1-853e790110bd', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:20:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (682fda10-ff24-4a12-a166-bbeb686b195b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:20:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (682fda10-ff24-4a12-a166-bbeb686b195b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:20:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a7e7b85-d20d-456d-b6ef-5554ec48ad9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:20:31 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Volume eed39e8e-f50c-4a66-9db1-853e790110bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed39e8e-f50c-4a66-9db1-853e790110bd', 'volume_size': 1} Sep 06 08:20:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:20:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:20:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1925717124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed39e8e-f50c-4a66-9db1-853e790110bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155846ae7ced4ca99b72b4b380927df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:20:31Z,use_quota=True,user_id='108f4b424c5e4ad1a3efc25eeb85fecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:20:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Creating volume eed39e8e-f50c-4a66-9db1-853e790110bd {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:20:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:20:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:20:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:20:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:20:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:20:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:20:31 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:20:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:20:31 devstack sudo[103659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd 1073741824 Sep 06 08:20:31 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:20:31 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root Sep 06 08:20:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd 1073741824" returned: 0 in 0.430s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:20:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:20:31 devstack sudo[103665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd Sep 06 08:20:31 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:20:32 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root Sep 06 08:20:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd" returned: 0 in 0.271s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:20:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:20:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:20:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a7e7b85-d20d-456d-b6ef-5554ec48ad9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed39e8e-f50c-4a66-9db1-853e790110bd', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:20:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d96537-b5cd-4510-9156-6d251722f99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:20:32 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Volume volume-eed39e8e-f50c-4a66-9db1-853e790110bd (eed39e8e-f50c-4a66-9db1-853e790110bd): created successfully Sep 06 08:20:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d96537-b5cd-4510-9156-6d251722f99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:20:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Flow 'volume_create_manager' (53e912f4-cfa8-405b-9124-cd77866ca753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:20:32 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-ffda4b3e-3924-406e-b0ac-8a45507ce41d tempest-TestStampPattern-391256870 None] Created volume successfully. Sep 06 08:20:42 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:20:42 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:20:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:20:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:20:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:20:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:20:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:20:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:20:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:20:59 devstack sudo[103815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:20:59 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:20:59 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root Sep 06 08:20:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.252s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:20:59 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:20:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager._thread_info {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:20:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread count: 28 {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 08:20:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread info: [<_MainThread(MainThread, started 139985167040640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:21:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-4ca52c3a-1c79-4b6e-bbe8-17e7a1e87a83 req-79f585a2-60c9-4eb1-a107-630f1218215b tempest-TestStampPattern-391256870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:21:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-4ca52c3a-1c79-4b6e-bbe8-17e7a1e87a83 req-79f585a2-60c9-4eb1-a107-630f1218215b tempest-TestStampPattern-391256870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:21:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-4ca52c3a-1c79-4b6e-bbe8-17e7a1e87a83 req-79f585a2-60c9-4eb1-a107-630f1218215b tempest-TestStampPattern-391256870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:21:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-4ca52c3a-1c79-4b6e-bbe8-17e7a1e87a83 req-79f585a2-60c9-4eb1-a107-630f1218215b tempest-TestStampPattern-391256870 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0', 'name': 'volume-eed39e8e-f50c-4a66-9db1-853e790110bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a7cb63e-11d1-401a-a910-20ce89ffe2ad', 'enforce_multipath': True} {{(pid=87307) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 08:21:00 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-4ca52c3a-1c79-4b6e-bbe8-17e7a1e87a83 req-79f585a2-60c9-4eb1-a107-630f1218215b tempest-TestStampPattern-391256870 None] attachment_update completed successfully. Sep 06 08:21:04 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-c515dbe3-a21b-4223-8252-1c95dfa57557 req-95faab4f-bb31-4508-8f8b-9d1a70042b74 tempest-TestStampPattern-391256870 None] Terminate volume connection completed successfully. Sep 06 08:21:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-c515dbe3-a21b-4223-8252-1c95dfa57557 req-95faab4f-bb31-4508-8f8b-9d1a70042b74 tempest-TestStampPattern-391256870 None] Deleting attachment 0a7cb63e-11d1-401a-a910-20ce89ffe2ad. {{(pid=87307) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 08:21:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-45fdedc2-f47e-43a3-a484-fb9b1c4148b2 tempest-TestStampPattern-391256870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:21:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-45fdedc2-f47e-43a3-a484-fb9b1c4148b2 tempest-TestStampPattern-391256870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:21:05 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-45fdedc2-f47e-43a3-a484-fb9b1c4148b2 tempest-TestStampPattern-391256870 None] Creating offline snapshot 19a4113b-8e80-4269-9f8b-74b327f315e7 of volume eed39e8e-f50c-4a66-9db1-853e790110bd {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:21:05 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[580fa144-6e7e-4592-976e-5cc76afb0248]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:21:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45fdedc2-f47e-43a3-a484-fb9b1c4148b2 tempest-TestStampPattern-391256870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:21:05 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd Sep 06 08:21:05 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:21:06 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Sep 06 08:21:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45fdedc2-f47e-43a3-a484-fb9b1c4148b2 tempest-TestStampPattern-391256870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd" returned: 0 in 0.390s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:21:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45fdedc2-f47e-43a3-a484-fb9b1c4148b2 tempest-TestStampPattern-391256870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.19a4113b-8e80-4269-9f8b-74b327f315e7 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:21:06 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.19a4113b-8e80-4269-9f8b-74b327f315e7 1G Sep 06 08:21:06 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:21:06 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Sep 06 08:21:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45fdedc2-f47e-43a3-a484-fb9b1c4148b2 tempest-TestStampPattern-391256870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.19a4113b-8e80-4269-9f8b-74b327f315e7 1G" returned: 0 in 0.382s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:21:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45fdedc2-f47e-43a3-a484-fb9b1c4148b2 tempest-TestStampPattern-391256870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eed39e8e-f50c-4a66-9db1-853e790110bd -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.19a4113b-8e80-4269-9f8b-74b327f315e7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:21:06 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eed39e8e-f50c-4a66-9db1-853e790110bd -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.19a4113b-8e80-4269-9f8b-74b327f315e7 Sep 06 08:21:06 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:21:06 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Sep 06 08:21:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45fdedc2-f47e-43a3-a484-fb9b1c4148b2 tempest-TestStampPattern-391256870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eed39e8e-f50c-4a66-9db1-853e790110bd -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.19a4113b-8e80-4269-9f8b-74b327f315e7" returned: 0 in 0.280s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:21:06 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-45fdedc2-f47e-43a3-a484-fb9b1c4148b2 tempest-TestStampPattern-391256870 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.19a4113b-8e80-4269-9f8b-74b327f315e7 is being set with open permissions: ugo+rw Sep 06 08:21:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45fdedc2-f47e-43a3-a484-fb9b1c4148b2 tempest-TestStampPattern-391256870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.19a4113b-8e80-4269-9f8b-74b327f315e7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:21:06 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.19a4113b-8e80-4269-9f8b-74b327f315e7 Sep 06 08:21:06 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:21:06 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Sep 06 08:21:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45fdedc2-f47e-43a3-a484-fb9b1c4148b2 tempest-TestStampPattern-391256870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.19a4113b-8e80-4269-9f8b-74b327f315e7" returned: 0 in 0.239s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:21:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45fdedc2-f47e-43a3-a484-fb9b1c4148b2 tempest-TestStampPattern-391256870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:21:06 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.info Sep 06 08:21:06 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:21:07 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Sep 06 08:21:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45fdedc2-f47e-43a3-a484-fb9b1c4148b2 tempest-TestStampPattern-391256870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.info" returned: 0 in 0.255s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:21:07 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-45fdedc2-f47e-43a3-a484-fb9b1c4148b2 tempest-TestStampPattern-391256870 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.info is being set with open permissions: ugo+rw Sep 06 08:21:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45fdedc2-f47e-43a3-a484-fb9b1c4148b2 tempest-TestStampPattern-391256870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:21:07 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.info Sep 06 08:21:07 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:21:07 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Sep 06 08:21:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45fdedc2-f47e-43a3-a484-fb9b1c4148b2 tempest-TestStampPattern-391256870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.info" returned: 0 in 0.245s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:21:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-45fdedc2-f47e-43a3-a484-fb9b1c4148b2 tempest-TestStampPattern-391256870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.873s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:21:07 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-45fdedc2-f47e-43a3-a484-fb9b1c4148b2 tempest-TestStampPattern-391256870 None] Create snapshot completed successfully Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Flow 'volume_create_manager' (0abab9dc-37fb-4b53-89f8-14b50f511551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b59276e-6253-46c1-9bc1-0083d3bdcbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b59276e-6253-46c1-9bc1-0083d3bdcbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-703148041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc9b78f-cdd2-489d-8dde-454ecc63b573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155846ae7ced4ca99b72b4b380927df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=19a4113b-8e80-4269-9f8b-74b327f315e7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:21:14Z,use_quota=True,user_id='108f4b424c5e4ad1a3efc25eeb85fecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b6433dc-4f12-4e9a-b4b8-a1d9b12e49bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b6433dc-4f12-4e9a-b4b8-a1d9b12e49bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aaba6c2-f763-43c1-bc0f-61f4ea9aea60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aaba6c2-f763-43c1-bc0f-61f4ea9aea60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7bc9b78f-cdd2-489d-8dde-454ecc63b573', 'volume_name': 'volume-7bc9b78f-cdd2-489d-8dde-454ecc63b573', 'volume_size': 1, 'snapshot_id': '19a4113b-8e80-4269-9f8b-74b327f315e7'}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40399231-6480-480e-909a-518ed2906710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40399231-6480-480e-909a-518ed2906710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41684a4-5526-4340-9d01-ae47c8ae4a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:21:14 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Volume 7bc9b78f-cdd2-489d-8dde-454ecc63b573: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7bc9b78f-cdd2-489d-8dde-454ecc63b573', 'volume_size': 1, 'snapshot_id': '19a4113b-8e80-4269-9f8b-74b327f315e7'} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Acquiring lock "cinder-quobyte-19a4113b-8e80-4269-9f8b-74b327f315e7-7bc9b78f-cdd2-489d-8dde-454ecc63b573" by "_create_volume_from_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Lock "cinder-quobyte-19a4113b-8e80-4269-9f8b-74b327f315e7-7bc9b78f-cdd2-489d-8dde-454ecc63b573" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Creating volume 7bc9b78f-cdd2-489d-8dde-454ecc63b573 from snapshot 19a4113b-8e80-4269-9f8b-74b327f315e7 {{(pid=87307) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Acquiring lock "cinder-quobyte-7bc9b78f-cdd2-489d-8dde-454ecc63b573" by "_copy_volume_from_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Lock "cinder-quobyte-7bc9b78f-cdd2-489d-8dde-454ecc63b573" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] snapshot: 19a4113b-8e80-4269-9f8b-74b327f315e7, volume: 7bc9b78f-cdd2-489d-8dde-454ecc63b573, {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5dde19-47f1-4cc0-90b7-0c48e1d6cccb]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.19a4113b-8e80-4269-9f8b-74b327f315e7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:21:14 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.19a4113b-8e80-4269-9f8b-74b327f315e7 Sep 06 08:21:14 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:21:14 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.19a4113b-8e80-4269-9f8b-74b327f315e7" returned: 0 in 0.361s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eed39e8e-f50c-4a66-9db1-853e790110bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b72f10-1270-456b-9d8f-32897c8465cd]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:21:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:21:14 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd Sep 06 08:21:14 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:21:15 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Sep 06 08:21:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd" returned: 0 in 0.381s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:21:15 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] will copy from snapshot at /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 06 08:21:15 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Creating direct copy from snapshot {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 06 08:21:15 devstack cinder-volume[87307]: DEBUG cinder.utils [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Path /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7bc9b78f-cdd2-489d-8dde-454ecc63b573 not found in is_blk_device check {{(pid=87307) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 06 08:21:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7bc9b78f-cdd2-489d-8dde-454ecc63b573 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:21:15 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7bc9b78f-cdd2-489d-8dde-454ecc63b573 Sep 06 08:21:15 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:21:20 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Sep 06 08:21:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7bc9b78f-cdd2-489d-8dde-454ecc63b573" returned: 0 in 5.826s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:21:20 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Image conversion details: src /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7bc9b78f-cdd2-489d-8dde-454ecc63b573 {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:21:20 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Converted 1024.00 MB image at 175.69 MB/s Sep 06 08:21:20 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7bc9b78f-cdd2-489d-8dde-454ecc63b573 is being set with open permissions: ugo+rw Sep 06 08:21:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7bc9b78f-cdd2-489d-8dde-454ecc63b573 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:21:21 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7bc9b78f-cdd2-489d-8dde-454ecc63b573 Sep 06 08:21:21 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:21:21 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Sep 06 08:21:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7bc9b78f-cdd2-489d-8dde-454ecc63b573" returned: 0 in 0.275s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:21:21 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Lock "cinder-quobyte-7bc9b78f-cdd2-489d-8dde-454ecc63b573" released by "_copy_volume_from_snapshot" :: held 6.931s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:21:21 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Lock "cinder-quobyte-19a4113b-8e80-4269-9f8b-74b327f315e7-7bc9b78f-cdd2-489d-8dde-454ecc63b573" released by "_create_volume_from_snapshot" :: held 7.037s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:21:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.058s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:21:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41684a4-5526-4340-9d01-ae47c8ae4a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bc9b78f-cdd2-489d-8dde-454ecc63b573', 'volume_size': 1, 'snapshot_id': '19a4113b-8e80-4269-9f8b-74b327f315e7'}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:21:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2229c065-33bd-4ff4-9efe-20f9c0641903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:21:21 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Volume volume-7bc9b78f-cdd2-489d-8dde-454ecc63b573 (7bc9b78f-cdd2-489d-8dde-454ecc63b573): created successfully Sep 06 08:21:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2229c065-33bd-4ff4-9efe-20f9c0641903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:21:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Flow 'volume_create_manager' (0abab9dc-37fb-4b53-89f8-14b50f511551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:21:21 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-dbad1e6b-9640-4905-8eb5-7e67323dd1fd tempest-TestStampPattern-391256870 None] Created volume successfully. Sep 06 08:21:31 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=13,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:21:31 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=16,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:21:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:21:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:21:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:21:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:21:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:21:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:21:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:21:59 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:21:59 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:21:59 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Sep 06 08:21:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.238s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:21:59 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:21:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager._thread_info {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:21:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread count: 28 {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 08:21:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread info: [<_MainThread(MainThread, started 139985167040640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:22:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-5cfc2975-4494-4411-b437-08a503925437 req-69d5b0d1-1bc8-4de7-a2a5-bcfbb35f5712 tempest-TestStampPattern-391256870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:22:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-5cfc2975-4494-4411-b437-08a503925437 req-69d5b0d1-1bc8-4de7-a2a5-bcfbb35f5712 tempest-TestStampPattern-391256870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:22:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [req-5cfc2975-4494-4411-b437-08a503925437 req-69d5b0d1-1bc8-4de7-a2a5-bcfbb35f5712 tempest-TestStampPattern-391256870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:22:03 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-5cfc2975-4494-4411-b437-08a503925437 req-69d5b0d1-1bc8-4de7-a2a5-bcfbb35f5712 tempest-TestStampPattern-391256870 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0', 'name': 'volume-7bc9b78f-cdd2-489d-8dde-454ecc63b573', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9a1f922-6cd7-4409-9a77-4cfb23fe5309', 'enforce_multipath': True} {{(pid=87307) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 08:22:03 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-5cfc2975-4494-4411-b437-08a503925437 req-69d5b0d1-1bc8-4de7-a2a5-bcfbb35f5712 tempest-TestStampPattern-391256870 None] attachment_update completed successfully. Sep 06 08:22:06 devstack cinder-volume[87307]: INFO cinder.volume.manager [req-e118e87b-2128-41b6-aa2f-a709708b94ce req-b334f643-3726-47ab-8256-b587dcc6ab3d tempest-TestStampPattern-391256870 None] Terminate volume connection completed successfully. Sep 06 08:22:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [req-e118e87b-2128-41b6-aa2f-a709708b94ce req-b334f643-3726-47ab-8256-b587dcc6ab3d tempest-TestStampPattern-391256870 None] Deleting attachment c9a1f922-6cd7-4409-9a77-4cfb23fe5309. {{(pid=87307) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 08:22:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f4d0b59e-a176-46c7-a46b-82cc94540be9 tempest-TestStampPattern-391256870 None] Acquiring lock "cinder-7bc9b78f-cdd2-489d-8dde-454ecc63b573-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:22:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f4d0b59e-a176-46c7-a46b-82cc94540be9 tempest-TestStampPattern-391256870 None] Lock "cinder-7bc9b78f-cdd2-489d-8dde-454ecc63b573-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:22:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f4d0b59e-a176-46c7-a46b-82cc94540be9 tempest-TestStampPattern-391256870 None] Acquiring lock "cinder-quobyte-7bc9b78f-cdd2-489d-8dde-454ecc63b573" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:22:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f4d0b59e-a176-46c7-a46b-82cc94540be9 tempest-TestStampPattern-391256870 None] Lock "cinder-quobyte-7bc9b78f-cdd2-489d-8dde-454ecc63b573" acquired by "delete_volume" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:22:10 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d833da-210c-4093-b463-3bb57ae4ed54]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:22:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f4d0b59e-a176-46c7-a46b-82cc94540be9 tempest-TestStampPattern-391256870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7bc9b78f-cdd2-489d-8dde-454ecc63b573 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:11 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7bc9b78f-cdd2-489d-8dde-454ecc63b573 Sep 06 08:22:11 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:11 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f4d0b59e-a176-46c7-a46b-82cc94540be9 tempest-TestStampPattern-391256870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7bc9b78f-cdd2-489d-8dde-454ecc63b573" returned: 0 in 0.342s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f4d0b59e-a176-46c7-a46b-82cc94540be9 tempest-TestStampPattern-391256870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7bc9b78f-cdd2-489d-8dde-454ecc63b573 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:11 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7bc9b78f-cdd2-489d-8dde-454ecc63b573 Sep 06 08:22:11 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:11 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f4d0b59e-a176-46c7-a46b-82cc94540be9 tempest-TestStampPattern-391256870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7bc9b78f-cdd2-489d-8dde-454ecc63b573" returned: 0 in 0.241s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:11 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f4d0b59e-a176-46c7-a46b-82cc94540be9 tempest-TestStampPattern-391256870 None] Lock "cinder-quobyte-7bc9b78f-cdd2-489d-8dde-454ecc63b573" released by "delete_volume" :: held 0.620s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:22:11 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-f4d0b59e-a176-46c7-a46b-82cc94540be9 tempest-TestStampPattern-391256870 None] Created reservations ['51a01466-2a4e-4822-8fb0-65ce34ea5a1e', '2cc757e3-b2db-41e4-a005-c9e401ef9364', 'db4b583e-2ff0-4745-8fe5-6bf2c4e69a79', '4d23182c-bd12-4d98-b90a-8188a2a23d6a'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:22:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f4d0b59e-a176-46c7-a46b-82cc94540be9 tempest-TestStampPattern-391256870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:22:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f4d0b59e-a176-46c7-a46b-82cc94540be9 tempest-TestStampPattern-391256870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:22:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f4d0b59e-a176-46c7-a46b-82cc94540be9 tempest-TestStampPattern-391256870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:22:11 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f4d0b59e-a176-46c7-a46b-82cc94540be9 tempest-TestStampPattern-391256870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:22:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f4d0b59e-a176-46c7-a46b-82cc94540be9 tempest-TestStampPattern-391256870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:22:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f4d0b59e-a176-46c7-a46b-82cc94540be9 tempest-TestStampPattern-391256870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:11 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:22:11 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:11 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f4d0b59e-a176-46c7-a46b-82cc94540be9 tempest-TestStampPattern-391256870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.231s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:11 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-f4d0b59e-a176-46c7-a46b-82cc94540be9 tempest-TestStampPattern-391256870 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:22:11 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f4d0b59e-a176-46c7-a46b-82cc94540be9 tempest-TestStampPattern-391256870 None] Deleted volume successfully. Sep 06 08:22:11 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f4d0b59e-a176-46c7-a46b-82cc94540be9 tempest-TestStampPattern-391256870 None] Lock "cinder-7bc9b78f-cdd2-489d-8dde-454ecc63b573-delete_volume" released by "delete_volume" :: held 1.039s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:22:12 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-078f749f-8593-4ece-8b8c-e6d17d38803d tempest-TestStampPattern-391256870 None] Acquiring lock "cinder-19a4113b-8e80-4269-9f8b-74b327f315e7-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:22:12 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-078f749f-8593-4ece-8b8c-e6d17d38803d tempest-TestStampPattern-391256870 None] Lock "cinder-19a4113b-8e80-4269-9f8b-74b327f315e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:22:12 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-078f749f-8593-4ece-8b8c-e6d17d38803d tempest-TestStampPattern-391256870 None] Acquiring lock "cinder-quobyte-eed39e8e-f50c-4a66-9db1-853e790110bd" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:22:12 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-078f749f-8593-4ece-8b8c-e6d17d38803d tempest-TestStampPattern-391256870 None] Lock "cinder-quobyte-eed39e8e-f50c-4a66-9db1-853e790110bd" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:22:12 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-078f749f-8593-4ece-8b8c-e6d17d38803d tempest-TestStampPattern-391256870 None] Acquiring lock "cinder-quobyte-19a4113b-8e80-4269-9f8b-74b327f315e7" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:22:12 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-078f749f-8593-4ece-8b8c-e6d17d38803d tempest-TestStampPattern-391256870 None] Lock "cinder-quobyte-19a4113b-8e80-4269-9f8b-74b327f315e7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:22:12 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-078f749f-8593-4ece-8b8c-e6d17d38803d tempest-TestStampPattern-391256870 None] Deleting offline snapshot 19a4113b-8e80-4269-9f8b-74b327f315e7 of volume eed39e8e-f50c-4a66-9db1-853e790110bd {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:22:12 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-078f749f-8593-4ece-8b8c-e6d17d38803d tempest-TestStampPattern-391256870 None] snapshot_file for this snap is: volume-eed39e8e-f50c-4a66-9db1-853e790110bd.19a4113b-8e80-4269-9f8b-74b327f315e7 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:22:12 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[80101320-2480-447e-b906-bb3d603f4363]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:22:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-078f749f-8593-4ece-8b8c-e6d17d38803d tempest-TestStampPattern-391256870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.19a4113b-8e80-4269-9f8b-74b327f315e7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:12 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.19a4113b-8e80-4269-9f8b-74b327f315e7 Sep 06 08:22:12 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:12 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-078f749f-8593-4ece-8b8c-e6d17d38803d tempest-TestStampPattern-391256870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.19a4113b-8e80-4269-9f8b-74b327f315e7" returned: 0 in 0.345s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:12 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-078f749f-8593-4ece-8b8c-e6d17d38803d tempest-TestStampPattern-391256870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eed39e8e-f50c-4a66-9db1-853e790110bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:22:12 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[514fc75e-89b7-4674-8deb-bd97966d599c]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:22:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-078f749f-8593-4ece-8b8c-e6d17d38803d tempest-TestStampPattern-391256870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:12 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd Sep 06 08:22:12 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:13 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-078f749f-8593-4ece-8b8c-e6d17d38803d tempest-TestStampPattern-391256870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd" returned: 0 in 0.519s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-078f749f-8593-4ece-8b8c-e6d17d38803d tempest-TestStampPattern-391256870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.19a4113b-8e80-4269-9f8b-74b327f315e7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:13 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.19a4113b-8e80-4269-9f8b-74b327f315e7 Sep 06 08:22:13 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:13 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-078f749f-8593-4ece-8b8c-e6d17d38803d tempest-TestStampPattern-391256870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.19a4113b-8e80-4269-9f8b-74b327f315e7" returned: 0 in 0.324s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-078f749f-8593-4ece-8b8c-e6d17d38803d tempest-TestStampPattern-391256870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.19a4113b-8e80-4269-9f8b-74b327f315e7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:13 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.19a4113b-8e80-4269-9f8b-74b327f315e7 Sep 06 08:22:13 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:13 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-078f749f-8593-4ece-8b8c-e6d17d38803d tempest-TestStampPattern-391256870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd.19a4113b-8e80-4269-9f8b-74b327f315e7" returned: 0 in 0.243s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-078f749f-8593-4ece-8b8c-e6d17d38803d tempest-TestStampPattern-391256870 None] Lock "cinder-quobyte-19a4113b-8e80-4269-9f8b-74b327f315e7" released by "_delete_snapshot" :: held 1.522s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:22:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-078f749f-8593-4ece-8b8c-e6d17d38803d tempest-TestStampPattern-391256870 None] Lock "cinder-quobyte-eed39e8e-f50c-4a66-9db1-853e790110bd" released by "delete_snapshot" :: held 1.545s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:22:13 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-078f749f-8593-4ece-8b8c-e6d17d38803d tempest-TestStampPattern-391256870 None] Created reservations ['2b50127e-d49d-4461-a724-36710e3b6c61', 'b3165370-bc51-4221-8889-42334a1b6e69', '842f5402-e65e-4808-8e3a-f540b114be2c', '8bd20137-9c36-47a0-9bfc-76501474fbce'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:22:13 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-078f749f-8593-4ece-8b8c-e6d17d38803d tempest-TestStampPattern-391256870 None] Delete snapshot completed successfully. Sep 06 08:22:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-078f749f-8593-4ece-8b8c-e6d17d38803d tempest-TestStampPattern-391256870 None] Lock "cinder-19a4113b-8e80-4269-9f8b-74b327f315e7-delete_snapshot" released by "delete_snapshot" :: held 1.669s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:22:17 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6aa3f1c4-98e7-419b-9f50-103707aae456 tempest-TestStampPattern-391256870 None] Acquiring lock "cinder-eed39e8e-f50c-4a66-9db1-853e790110bd-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:22:17 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6aa3f1c4-98e7-419b-9f50-103707aae456 tempest-TestStampPattern-391256870 None] Lock "cinder-eed39e8e-f50c-4a66-9db1-853e790110bd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:22:17 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6aa3f1c4-98e7-419b-9f50-103707aae456 tempest-TestStampPattern-391256870 None] Acquiring lock "cinder-quobyte-eed39e8e-f50c-4a66-9db1-853e790110bd" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:22:17 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6aa3f1c4-98e7-419b-9f50-103707aae456 tempest-TestStampPattern-391256870 None] Lock "cinder-quobyte-eed39e8e-f50c-4a66-9db1-853e790110bd" acquired by "delete_volume" :: waited 0.019s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:22:17 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d73115-6e3b-4f3e-9614-0e0ab48fe5a5]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:22:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6aa3f1c4-98e7-419b-9f50-103707aae456 tempest-TestStampPattern-391256870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:17 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd Sep 06 08:22:17 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:18 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6aa3f1c4-98e7-419b-9f50-103707aae456 tempest-TestStampPattern-391256870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd" returned: 0 in 0.356s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6aa3f1c4-98e7-419b-9f50-103707aae456 tempest-TestStampPattern-391256870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:18 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd Sep 06 08:22:18 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:18 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6aa3f1c4-98e7-419b-9f50-103707aae456 tempest-TestStampPattern-391256870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-eed39e8e-f50c-4a66-9db1-853e790110bd" returned: 0 in 0.236s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:18 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6aa3f1c4-98e7-419b-9f50-103707aae456 tempest-TestStampPattern-391256870 None] Lock "cinder-quobyte-eed39e8e-f50c-4a66-9db1-853e790110bd" released by "delete_volume" :: held 0.648s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:22:18 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-6aa3f1c4-98e7-419b-9f50-103707aae456 tempest-TestStampPattern-391256870 None] Created reservations ['e12f386b-ef71-4f87-9527-5599a8b3dddd', '16b78f17-fa35-474c-b10f-4138bec44372', 'e335fadb-5c23-4f16-8b64-14a2d154807c', 'c505b97e-8d42-44a1-86b1-c6d7d936fdf9'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:22:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6aa3f1c4-98e7-419b-9f50-103707aae456 tempest-TestStampPattern-391256870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:22:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6aa3f1c4-98e7-419b-9f50-103707aae456 tempest-TestStampPattern-391256870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:22:18 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6aa3f1c4-98e7-419b-9f50-103707aae456 tempest-TestStampPattern-391256870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:22:18 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6aa3f1c4-98e7-419b-9f50-103707aae456 tempest-TestStampPattern-391256870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:22:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6aa3f1c4-98e7-419b-9f50-103707aae456 tempest-TestStampPattern-391256870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:22:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6aa3f1c4-98e7-419b-9f50-103707aae456 tempest-TestStampPattern-391256870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:18 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:22:18 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:18 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6aa3f1c4-98e7-419b-9f50-103707aae456 tempest-TestStampPattern-391256870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.246s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:18 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6aa3f1c4-98e7-419b-9f50-103707aae456 tempest-TestStampPattern-391256870 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:22:18 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-6aa3f1c4-98e7-419b-9f50-103707aae456 tempest-TestStampPattern-391256870 None] Deleted volume successfully. Sep 06 08:22:18 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6aa3f1c4-98e7-419b-9f50-103707aae456 tempest-TestStampPattern-391256870 None] Lock "cinder-eed39e8e-f50c-4a66-9db1-853e790110bd-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:22:28 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:UPDATE=23,cinder:SELECT=24,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:22:28 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=23,cinder:UPDATE=24,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:22:32 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:22:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Flow 'volume_create_manager' (cf2b0d4a-0654-4bc4-8713-b29181daf997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:22:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39ede64-b844-4ffb-abf1-3f6823533f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:22:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39ede64-b844-4ffb-abf1-3f6823533f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65b0b5a-32bc-43be-b98d-1401ca623837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a014729e7f469f948d502a6d7e0ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:22:33Z,use_quota=True,user_id='a00d27c9654a4b87865b921b5aae2e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f00c904f-ee6e-457e-9797-49f8e3303655),volume_type_id=f00c904f-ee6e-457e-9797-49f8e3303655)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:22:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409f0511-5d2b-4eca-a3c7-f7c23a4928a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:22:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409f0511-5d2b-4eca-a3c7-f7c23a4928a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:22:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f46f228-3f60-4741-a5da-5158f259d168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:22:33 devstack cinder-volume[87307]: DEBUG cinder.image.glance [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Creating Keystone auth plugin from conf {{(pid=87307) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 08:22:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f46f228-3f60-4741-a5da-5158f259d168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b65b0b5a-32bc-43be-b98d-1401ca623837', 'volume_name': 'volume-b65b0b5a-32bc-43be-b98d-1401ca623837', 'volume_size': 1, 'image_id': '60a88120-f85d-424c-8986-87c5c97c7e65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60a88120-f85d-424c-8986-87c5c97c7e65', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7248dd3d7ce37e9a5a55402fc5f67ff4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd0a014729e7f469f948d502a6d7e0ba3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0ed06cc411ee0f8bf5c4a38d1686ed03cebb04edcf5a81454b472e35954d52995262273f7dd1edcb133e92991527306571269d3a652dc99e3d71bd425c2b6282', 'id': '60a88120-f85d-424c-8986-87c5c97c7e65', 'created_at': datetime.datetime(2026, 9, 6, 6, 22, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 6, 22, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60a88120-f85d-424c-8986-87c5c97c7e65/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:22:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65924ea-e770-49ec-9042-0519442c2b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:22:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65924ea-e770-49ec-9042-0519442c2b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:22:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7309c3-9760-406c-9f05-00567d19fc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:22:33 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Volume b65b0b5a-32bc-43be-b98d-1401ca623837: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b65b0b5a-32bc-43be-b98d-1401ca623837', 'volume_size': 1, 'image_id': '60a88120-f85d-424c-8986-87c5c97c7e65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60a88120-f85d-424c-8986-87c5c97c7e65', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7248dd3d7ce37e9a5a55402fc5f67ff4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd0a014729e7f469f948d502a6d7e0ba3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0ed06cc411ee0f8bf5c4a38d1686ed03cebb04edcf5a81454b472e35954d52995262273f7dd1edcb133e92991527306571269d3a652dc99e3d71bd425c2b6282', 'id': '60a88120-f85d-424c-8986-87c5c97c7e65', 'created_at': datetime.datetime(2026, 9, 6, 6, 22, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 6, 22, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60a88120-f85d-424c-8986-87c5c97c7e65/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 06 08:22:33 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Trying to clone b65b0b5a-32bc-43be-b98d-1401ca623837 from image 60a88120-f85d-424c-8986-87c5c97c7e65 at location (None, [{'url': 'file:///opt/stack/data/glance/images/60a88120-f85d-424c-8986-87c5c97c7e65', 'metadata': {}}]). {{(pid=87307) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 08:22:33 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 08:22:33 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Image download 0.00 MB at 0.00 MB/s Sep 06 08:22:33 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76e22e8-6fbc-469c-9e6d-682845babdd4]: (4, 'raw') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:22:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:33 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD Sep 06 08:22:33 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:33 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD" returned: 0 in 0.322s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:33 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD Sep 06 08:22:33 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:34 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD" returned: 1 in 0.317s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 08:22:34 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Temporary image 60a88120-f85d-424c-8986-87c5c97c7e65 is fetched for user a00d27c9654a4b87865b921b5aae2e17. {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 08:22:34 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[934f4a92-8e93-49f5-9e09-29c7e41b46c1]: (4, 'raw') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:22:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:34 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD Sep 06 08:22:34 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:34 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:34 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD Sep 06 08:22:34 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:34 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD" returned: 1 in 0.315s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 08:22:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:22:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:22:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65b0b5a-32bc-43be-b98d-1401ca623837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a014729e7f469f948d502a6d7e0ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:22:33Z,use_quota=True,user_id='a00d27c9654a4b87865b921b5aae2e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f00c904f-ee6e-457e-9797-49f8e3303655),volume_type_id=f00c904f-ee6e-457e-9797-49f8e3303655)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:22:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Creating volume b65b0b5a-32bc-43be-b98d-1401ca623837 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:22:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:22:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:22:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:22:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:22:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:22:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:22:34 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:22:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b65b0b5a-32bc-43be-b98d-1401ca623837 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:34 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b65b0b5a-32bc-43be-b98d-1401ca623837 1073741824 Sep 06 08:22:34 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:35 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b65b0b5a-32bc-43be-b98d-1401ca623837 1073741824" returned: 0 in 0.398s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b65b0b5a-32bc-43be-b98d-1401ca623837 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:35 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b65b0b5a-32bc-43be-b98d-1401ca623837 Sep 06 08:22:35 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:35 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b65b0b5a-32bc-43be-b98d-1401ca623837" returned: 0 in 0.242s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:22:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:22:35 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Attempting download of 60a88120-f85d-424c-8986-87c5c97c7e65 ((None, [{'url': 'file:///opt/stack/data/glance/images/60a88120-f85d-424c-8986-87c5c97c7e65', 'metadata': {}}])) to volume b65b0b5a-32bc-43be-b98d-1401ca623837. {{(pid=87307) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 08:22:35 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7314717-fd60-4c63-8e46-217c61f1b902]: (4, 'raw') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:22:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_60a88120-f85d-424c-8986-87c5c97c7e65_enc6fi3x {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:35 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_60a88120-f85d-424c-8986-87c5c97c7e65_enc6fi3x Sep 06 08:22:35 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:35 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_60a88120-f85d-424c-8986-87c5c97c7e65_enc6fi3x" returned: 0 in 0.329s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60a88120-f85d-424c-8986-87c5c97c7e65_enc6fi3x {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:35 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60a88120-f85d-424c-8986-87c5c97c7e65_enc6fi3x Sep 06 08:22:35 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:36 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60a88120-f85d-424c-8986-87c5c97c7e65_enc6fi3x" returned: 1 in 0.316s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60a88120-f85d-424c-8986-87c5c97c7e65_enc6fi3x' failed. Not Retrying. {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 08:22:36 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ab5586-9afe-47cc-baa5-b4ebd3ed2f59]: (4, 'raw') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:22:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:36 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD Sep 06 08:22:36 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:36 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD" returned: 0 in 0.317s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:36 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD Sep 06 08:22:36 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:36 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD" returned: 1 in 0.321s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 08:22:36 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] 60a88120-f85d-424c-8986-87c5c97c7e65 was raw, converting to qcow2 {{(pid=87307) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 08:22:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b65b0b5a-32bc-43be-b98d-1401ca623837 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:36 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b65b0b5a-32bc-43be-b98d-1401ca623837 Sep 06 08:22:36 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:37 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b65b0b5a-32bc-43be-b98d-1401ca623837" returned: 0 in 0.451s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:37 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_60a88120-f85d-424c-8986-87c5c97c7e65_3r244vsqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b65b0b5a-32bc-43be-b98d-1401ca623837 {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:22:37 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Converted 0.00 MB image at 0.00 MB/s Sep 06 08:22:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b65b0b5a-32bc-43be-b98d-1401ca623837 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:37 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b65b0b5a-32bc-43be-b98d-1401ca623837 1G Sep 06 08:22:37 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:37 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b65b0b5a-32bc-43be-b98d-1401ca623837 1G" returned: 0 in 0.302s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:37 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Downloaded image 60a88120-f85d-424c-8986-87c5c97c7e65 ((None, [{'url': 'file:///opt/stack/data/glance/images/60a88120-f85d-424c-8986-87c5c97c7e65', 'metadata': {}}])) to volume b65b0b5a-32bc-43be-b98d-1401ca623837 successfully. {{(pid=87307) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 08:22:37 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Temporary image 60a88120-f85d-424c-8986-87c5c97c7e65 for user a00d27c9654a4b87865b921b5aae2e17 is deleted. {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 08:22:37 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Marking volume b65b0b5a-32bc-43be-b98d-1401ca623837 as bootable. {{(pid=87307) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 08:22:37 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Copying metadata from image 60a88120-f85d-424c-8986-87c5c97c7e65 to b65b0b5a-32bc-43be-b98d-1401ca623837. {{(pid=87307) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 08:22:37 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Creating volume glance metadata for volume b65b0b5a-32bc-43be-b98d-1401ca623837 backed by image 60a88120-f85d-424c-8986-87c5c97c7e65 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '60a88120-f85d-424c-8986-87c5c97c7e65', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7248dd3d7ce37e9a5a55402fc5f67ff4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87307) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 08:22:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7309c3-9760-406c-9f05-00567d19fc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b65b0b5a-32bc-43be-b98d-1401ca623837', 'volume_size': 1, 'image_id': '60a88120-f85d-424c-8986-87c5c97c7e65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60a88120-f85d-424c-8986-87c5c97c7e65', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7248dd3d7ce37e9a5a55402fc5f67ff4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd0a014729e7f469f948d502a6d7e0ba3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0ed06cc411ee0f8bf5c4a38d1686ed03cebb04edcf5a81454b472e35954d52995262273f7dd1edcb133e92991527306571269d3a652dc99e3d71bd425c2b6282', 'id': '60a88120-f85d-424c-8986-87c5c97c7e65', 'created_at': datetime.datetime(2026, 9, 6, 6, 22, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 6, 22, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60a88120-f85d-424c-8986-87c5c97c7e65/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:22:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01a9bd5-9c48-41ec-b213-0c1f0d5d47ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:22:37 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Volume volume-b65b0b5a-32bc-43be-b98d-1401ca623837 (b65b0b5a-32bc-43be-b98d-1401ca623837): created successfully Sep 06 08:22:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01a9bd5-9c48-41ec-b213-0c1f0d5d47ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:22:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Flow 'volume_create_manager' (cf2b0d4a-0654-4bc4-8713-b29181daf997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:22:37 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-356f40c9-f911-4e68-bafe-0709acc5072c tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Created volume successfully. Sep 06 08:22:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-608243bd-7d11-4d13-972d-73ad1e833bc1 tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Acquiring lock "cinder-b65b0b5a-32bc-43be-b98d-1401ca623837-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:22:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-608243bd-7d11-4d13-972d-73ad1e833bc1 tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Lock "cinder-b65b0b5a-32bc-43be-b98d-1401ca623837-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:22:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-608243bd-7d11-4d13-972d-73ad1e833bc1 tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Acquiring lock "cinder-quobyte-b65b0b5a-32bc-43be-b98d-1401ca623837" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:22:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-608243bd-7d11-4d13-972d-73ad1e833bc1 tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Lock "cinder-quobyte-b65b0b5a-32bc-43be-b98d-1401ca623837" acquired by "delete_volume" :: waited 0.014s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:22:38 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a55d15c-13f5-4f97-9110-85123942fdc5]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:22:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-608243bd-7d11-4d13-972d-73ad1e833bc1 tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b65b0b5a-32bc-43be-b98d-1401ca623837 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:38 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b65b0b5a-32bc-43be-b98d-1401ca623837 Sep 06 08:22:38 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:38 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-608243bd-7d11-4d13-972d-73ad1e833bc1 tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b65b0b5a-32bc-43be-b98d-1401ca623837" returned: 0 in 0.353s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-608243bd-7d11-4d13-972d-73ad1e833bc1 tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b65b0b5a-32bc-43be-b98d-1401ca623837 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:38 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b65b0b5a-32bc-43be-b98d-1401ca623837 Sep 06 08:22:38 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:38 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-608243bd-7d11-4d13-972d-73ad1e833bc1 tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b65b0b5a-32bc-43be-b98d-1401ca623837" returned: 0 in 0.243s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-608243bd-7d11-4d13-972d-73ad1e833bc1 tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Lock "cinder-quobyte-b65b0b5a-32bc-43be-b98d-1401ca623837" released by "delete_volume" :: held 0.632s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:22:38 devstack cinder-volume[87307]: WARNING cinder.quota [None req-608243bd-7d11-4d13-972d-73ad1e833bc1 tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:22:38 devstack cinder-volume[87307]: WARNING cinder.quota [None req-608243bd-7d11-4d13-972d-73ad1e833bc1 tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 06 08:22:38 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-608243bd-7d11-4d13-972d-73ad1e833bc1 tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Created reservations ['d4c68546-e467-402a-bd6a-1c7296109776', 'c2f3bd93-0aa1-42c2-8b37-8c62a00d1a61', '5b696acd-7dc5-49c2-bce0-0c22860cd50d', '3c6675eb-69d3-4085-a6ec-fbb6f2683ac0'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:22:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-608243bd-7d11-4d13-972d-73ad1e833bc1 tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:22:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-608243bd-7d11-4d13-972d-73ad1e833bc1 tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:22:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-608243bd-7d11-4d13-972d-73ad1e833bc1 tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:22:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-608243bd-7d11-4d13-972d-73ad1e833bc1 tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:22:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-608243bd-7d11-4d13-972d-73ad1e833bc1 tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:22:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-608243bd-7d11-4d13-972d-73ad1e833bc1 tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:39 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:22:39 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:39 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-608243bd-7d11-4d13-972d-73ad1e833bc1 tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.241s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:39 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-608243bd-7d11-4d13-972d-73ad1e833bc1 tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:22:39 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-608243bd-7d11-4d13-972d-73ad1e833bc1 tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Deleted volume successfully. Sep 06 08:22:39 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-608243bd-7d11-4d13-972d-73ad1e833bc1 tempest-VolumeAndVolumeTypeFromImageTest-1419889322 None] Lock "cinder-b65b0b5a-32bc-43be-b98d-1401ca623837-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:22:43 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:22:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Flow 'volume_create_manager' (424a6267-8bbd-4196-9338-557a78fe6761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:22:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95bb2798-6b62-4688-810a-6854b9959b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:22:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95bb2798-6b62-4688-810a-6854b9959b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1750722374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3021c4-c2f1-4217-87f7-e8331c02eed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e259556d3ad04697af896c5ba05365b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:22:43Z,use_quota=True,user_id='1770d392970f45b390fd67603f2cbfae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:22:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98198597-d2c0-47e6-b1cb-8f12fe366857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:22:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98198597-d2c0-47e6-b1cb-8f12fe366857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:22:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a17a7b-7574-45a1-a56c-5fa5dd71e83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:22:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a17a7b-7574-45a1-a56c-5fa5dd71e83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a3021c4-c2f1-4217-87f7-e8331c02eed0', 'volume_name': 'volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:22:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4079d1-3dde-4aec-89f2-316b09c45f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:22:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4079d1-3dde-4aec-89f2-316b09c45f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:22:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b0b3e4-62f0-4423-afbc-b69549d3e636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:22:43 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Volume 9a3021c4-c2f1-4217-87f7-e8331c02eed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0', 'volume_size': 1} Sep 06 08:22:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:22:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:22:43 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1750722374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3021c4-c2f1-4217-87f7-e8331c02eed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e259556d3ad04697af896c5ba05365b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:22:43Z,use_quota=True,user_id='1770d392970f45b390fd67603f2cbfae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:22:43 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Creating volume 9a3021c4-c2f1-4217-87f7-e8331c02eed0 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:22:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:22:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:22:43 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:22:43 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:22:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:22:43 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:22:43 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:22:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:43 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0 1073741824 Sep 06 08:22:43 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:43 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0 1073741824" returned: 0 in 0.392s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:43 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0 Sep 06 08:22:43 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:44 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0" returned: 0 in 0.248s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:44 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:22:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:22:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b0b3e4-62f0-4423-afbc-b69549d3e636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:22:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f74f2b1-1cf2-459c-bca9-54174ae4ed0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:22:44 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Volume volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0 (9a3021c4-c2f1-4217-87f7-e8331c02eed0): created successfully Sep 06 08:22:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f74f2b1-1cf2-459c-bca9-54174ae4ed0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:22:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Flow 'volume_create_manager' (424a6267-8bbd-4196-9338-557a78fe6761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:22:44 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-06ebda87-52f5-4565-9451-05d96e09ad99 tempest-VolumeDependencyTests-422894319 None] Created volume successfully. Sep 06 08:22:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cf14721a-38ae-478f-8636-7947701f7807 tempest-VolumeDependencyTests-422894319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:22:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cf14721a-38ae-478f-8636-7947701f7807 tempest-VolumeDependencyTests-422894319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:22:44 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-cf14721a-38ae-478f-8636-7947701f7807 tempest-VolumeDependencyTests-422894319 None] Creating offline snapshot 351887f7-02ae-4917-bbab-26ac741573cf of volume 9a3021c4-c2f1-4217-87f7-e8331c02eed0 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:22:44 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf42a4f8-e880-4c2b-bfaa-bc422eb1d4ad]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:22:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cf14721a-38ae-478f-8636-7947701f7807 tempest-VolumeDependencyTests-422894319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:44 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0 Sep 06 08:22:44 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:44 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cf14721a-38ae-478f-8636-7947701f7807 tempest-VolumeDependencyTests-422894319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0" returned: 0 in 0.347s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cf14721a-38ae-478f-8636-7947701f7807 tempest-VolumeDependencyTests-422894319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.351887f7-02ae-4917-bbab-26ac741573cf 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:45 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.351887f7-02ae-4917-bbab-26ac741573cf 1G Sep 06 08:22:45 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:45 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cf14721a-38ae-478f-8636-7947701f7807 tempest-VolumeDependencyTests-422894319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.351887f7-02ae-4917-bbab-26ac741573cf 1G" returned: 0 in 0.375s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cf14721a-38ae-478f-8636-7947701f7807 tempest-VolumeDependencyTests-422894319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.351887f7-02ae-4917-bbab-26ac741573cf {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:45 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.351887f7-02ae-4917-bbab-26ac741573cf Sep 06 08:22:45 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:45 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cf14721a-38ae-478f-8636-7947701f7807 tempest-VolumeDependencyTests-422894319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.351887f7-02ae-4917-bbab-26ac741573cf" returned: 0 in 0.285s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:45 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-cf14721a-38ae-478f-8636-7947701f7807 tempest-VolumeDependencyTests-422894319 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.351887f7-02ae-4917-bbab-26ac741573cf is being set with open permissions: ugo+rw Sep 06 08:22:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cf14721a-38ae-478f-8636-7947701f7807 tempest-VolumeDependencyTests-422894319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.351887f7-02ae-4917-bbab-26ac741573cf {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:45 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.351887f7-02ae-4917-bbab-26ac741573cf Sep 06 08:22:45 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:45 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cf14721a-38ae-478f-8636-7947701f7807 tempest-VolumeDependencyTests-422894319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.351887f7-02ae-4917-bbab-26ac741573cf" returned: 0 in 0.241s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cf14721a-38ae-478f-8636-7947701f7807 tempest-VolumeDependencyTests-422894319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:45 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.info Sep 06 08:22:45 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:46 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cf14721a-38ae-478f-8636-7947701f7807 tempest-VolumeDependencyTests-422894319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.info" returned: 0 in 0.258s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:46 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-cf14721a-38ae-478f-8636-7947701f7807 tempest-VolumeDependencyTests-422894319 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.info is being set with open permissions: ugo+rw Sep 06 08:22:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cf14721a-38ae-478f-8636-7947701f7807 tempest-VolumeDependencyTests-422894319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:46 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.info Sep 06 08:22:46 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:46 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cf14721a-38ae-478f-8636-7947701f7807 tempest-VolumeDependencyTests-422894319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.info" returned: 0 in 0.233s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cf14721a-38ae-478f-8636-7947701f7807 tempest-VolumeDependencyTests-422894319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.821s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:22:46 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-cf14721a-38ae-478f-8636-7947701f7807 tempest-VolumeDependencyTests-422894319 None] Create snapshot completed successfully Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Flow 'volume_create_manager' (030d1aa2-d02c-494a-969a-674dba457b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c87f6e1-d91b-405d-a987-00b34e7fd5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c87f6e1-d91b-405d-a987-00b34e7fd5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-452060493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=538577cd-d061-4f8f-b2cd-280a572ad319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e259556d3ad04697af896c5ba05365b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=351887f7-02ae-4917-bbab-26ac741573cf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:22:47Z,use_quota=True,user_id='1770d392970f45b390fd67603f2cbfae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0973a785-eddc-4653-87c1-357dc9a93768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0973a785-eddc-4653-87c1-357dc9a93768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa7a46f-daab-4cd1-85a4-fcd99d1f2c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa7a46f-daab-4cd1-85a4-fcd99d1f2c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '538577cd-d061-4f8f-b2cd-280a572ad319', 'volume_name': 'volume-538577cd-d061-4f8f-b2cd-280a572ad319', 'volume_size': 1, 'snapshot_id': '351887f7-02ae-4917-bbab-26ac741573cf'}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59580d9a-bf4b-457d-aaa7-9107cd7678c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59580d9a-bf4b-457d-aaa7-9107cd7678c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a61cf3-46d8-493a-9a1f-1c89bafc7c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:22:47 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Volume 538577cd-d061-4f8f-b2cd-280a572ad319: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-538577cd-d061-4f8f-b2cd-280a572ad319', 'volume_size': 1, 'snapshot_id': '351887f7-02ae-4917-bbab-26ac741573cf'} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Acquiring lock "cinder-quobyte-351887f7-02ae-4917-bbab-26ac741573cf-538577cd-d061-4f8f-b2cd-280a572ad319" by "_create_volume_from_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Lock "cinder-quobyte-351887f7-02ae-4917-bbab-26ac741573cf-538577cd-d061-4f8f-b2cd-280a572ad319" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Creating volume 538577cd-d061-4f8f-b2cd-280a572ad319 from snapshot 351887f7-02ae-4917-bbab-26ac741573cf {{(pid=87307) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Acquiring lock "cinder-quobyte-538577cd-d061-4f8f-b2cd-280a572ad319" by "_copy_volume_from_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Lock "cinder-quobyte-538577cd-d061-4f8f-b2cd-280a572ad319" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] snapshot: 351887f7-02ae-4917-bbab-26ac741573cf, volume: 538577cd-d061-4f8f-b2cd-280a572ad319, {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0612ca48-06b2-4b82-89ef-0be51da2d3b5]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.351887f7-02ae-4917-bbab-26ac741573cf {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:47 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.351887f7-02ae-4917-bbab-26ac741573cf Sep 06 08:22:47 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:47 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.351887f7-02ae-4917-bbab-26ac741573cf" returned: 0 in 0.366s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e00f58-8078-4916-bcc6-2db0ba763dba]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:22:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:47 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0 Sep 06 08:22:47 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:48 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0" returned: 0 in 0.355s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:48 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] will copy from snapshot at /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0 {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 06 08:22:48 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Creating direct copy from snapshot {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 06 08:22:48 devstack cinder-volume[87307]: DEBUG cinder.utils [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Path /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-538577cd-d061-4f8f-b2cd-280a572ad319 not found in is_blk_device check {{(pid=87307) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 06 08:22:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-538577cd-d061-4f8f-b2cd-280a572ad319 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:48 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-538577cd-d061-4f8f-b2cd-280a572ad319 Sep 06 08:22:48 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:52 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-538577cd-d061-4f8f-b2cd-280a572ad319" returned: 0 in 4.062s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:52 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Image conversion details: src /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0, size 1024.00 MB, duration 4.06 sec, destination /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-538577cd-d061-4f8f-b2cd-280a572ad319 {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:22:52 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Converted 1024.00 MB image at 252.03 MB/s Sep 06 08:22:52 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-538577cd-d061-4f8f-b2cd-280a572ad319 is being set with open permissions: ugo+rw Sep 06 08:22:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-538577cd-d061-4f8f-b2cd-280a572ad319 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:52 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-538577cd-d061-4f8f-b2cd-280a572ad319 Sep 06 08:22:52 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:52 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-538577cd-d061-4f8f-b2cd-280a572ad319" returned: 0 in 0.250s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Lock "cinder-quobyte-538577cd-d061-4f8f-b2cd-280a572ad319" released by "_copy_volume_from_snapshot" :: held 5.107s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:22:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Lock "cinder-quobyte-351887f7-02ae-4917-bbab-26ac741573cf-538577cd-d061-4f8f-b2cd-280a572ad319" released by "_create_volume_from_snapshot" :: held 5.173s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:22:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.188s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:22:52 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a61cf3-46d8-493a-9a1f-1c89bafc7c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-538577cd-d061-4f8f-b2cd-280a572ad319', 'volume_size': 1, 'snapshot_id': '351887f7-02ae-4917-bbab-26ac741573cf'}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:22:52 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb0ced9a-606c-4ec5-b963-2dea17318a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:22:52 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Volume volume-538577cd-d061-4f8f-b2cd-280a572ad319 (538577cd-d061-4f8f-b2cd-280a572ad319): created successfully Sep 06 08:22:52 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb0ced9a-606c-4ec5-b963-2dea17318a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:22:52 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Flow 'volume_create_manager' (030d1aa2-d02c-494a-969a-674dba457b8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:22:52 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f79cbb6c-c6ed-4961-8a23-6a0990b759c2 tempest-VolumeDependencyTests-422894319 None] Created volume successfully. Sep 06 08:22:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bdf3fd7f-7e1b-489b-b2e3-2915c9c27fbf tempest-VolumeDependencyTests-422894319 None] Acquiring lock "cinder-351887f7-02ae-4917-bbab-26ac741573cf-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:22:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bdf3fd7f-7e1b-489b-b2e3-2915c9c27fbf tempest-VolumeDependencyTests-422894319 None] Lock "cinder-351887f7-02ae-4917-bbab-26ac741573cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:22:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bdf3fd7f-7e1b-489b-b2e3-2915c9c27fbf tempest-VolumeDependencyTests-422894319 None] Acquiring lock "cinder-quobyte-9a3021c4-c2f1-4217-87f7-e8331c02eed0" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:22:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bdf3fd7f-7e1b-489b-b2e3-2915c9c27fbf tempest-VolumeDependencyTests-422894319 None] Lock "cinder-quobyte-9a3021c4-c2f1-4217-87f7-e8331c02eed0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:22:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bdf3fd7f-7e1b-489b-b2e3-2915c9c27fbf tempest-VolumeDependencyTests-422894319 None] Acquiring lock "cinder-quobyte-351887f7-02ae-4917-bbab-26ac741573cf" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:22:52 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bdf3fd7f-7e1b-489b-b2e3-2915c9c27fbf tempest-VolumeDependencyTests-422894319 None] Lock "cinder-quobyte-351887f7-02ae-4917-bbab-26ac741573cf" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:22:52 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-bdf3fd7f-7e1b-489b-b2e3-2915c9c27fbf tempest-VolumeDependencyTests-422894319 None] Deleting offline snapshot 351887f7-02ae-4917-bbab-26ac741573cf of volume 9a3021c4-c2f1-4217-87f7-e8331c02eed0 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:22:52 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-bdf3fd7f-7e1b-489b-b2e3-2915c9c27fbf tempest-VolumeDependencyTests-422894319 None] snapshot_file for this snap is: volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.351887f7-02ae-4917-bbab-26ac741573cf {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:22:52 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ad04a3-4008-4bf6-ab22-f5040481a40b]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:22:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bdf3fd7f-7e1b-489b-b2e3-2915c9c27fbf tempest-VolumeDependencyTests-422894319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.351887f7-02ae-4917-bbab-26ac741573cf {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:52 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.351887f7-02ae-4917-bbab-26ac741573cf Sep 06 08:22:52 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:53 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bdf3fd7f-7e1b-489b-b2e3-2915c9c27fbf tempest-VolumeDependencyTests-422894319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.351887f7-02ae-4917-bbab-26ac741573cf" returned: 0 in 0.346s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-bdf3fd7f-7e1b-489b-b2e3-2915c9c27fbf tempest-VolumeDependencyTests-422894319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:22:53 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b00c5a-0275-432d-9b68-579e0b70dc9f]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:22:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bdf3fd7f-7e1b-489b-b2e3-2915c9c27fbf tempest-VolumeDependencyTests-422894319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:53 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0 Sep 06 08:22:53 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:53 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bdf3fd7f-7e1b-489b-b2e3-2915c9c27fbf tempest-VolumeDependencyTests-422894319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0" returned: 0 in 0.524s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bdf3fd7f-7e1b-489b-b2e3-2915c9c27fbf tempest-VolumeDependencyTests-422894319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.351887f7-02ae-4917-bbab-26ac741573cf {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:53 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.351887f7-02ae-4917-bbab-26ac741573cf Sep 06 08:22:53 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:53 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bdf3fd7f-7e1b-489b-b2e3-2915c9c27fbf tempest-VolumeDependencyTests-422894319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.351887f7-02ae-4917-bbab-26ac741573cf" returned: 0 in 0.331s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bdf3fd7f-7e1b-489b-b2e3-2915c9c27fbf tempest-VolumeDependencyTests-422894319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.351887f7-02ae-4917-bbab-26ac741573cf {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:53 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.351887f7-02ae-4917-bbab-26ac741573cf Sep 06 08:22:53 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:54 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bdf3fd7f-7e1b-489b-b2e3-2915c9c27fbf tempest-VolumeDependencyTests-422894319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0.351887f7-02ae-4917-bbab-26ac741573cf" returned: 0 in 0.234s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bdf3fd7f-7e1b-489b-b2e3-2915c9c27fbf tempest-VolumeDependencyTests-422894319 None] Lock "cinder-quobyte-351887f7-02ae-4917-bbab-26ac741573cf" released by "_delete_snapshot" :: held 1.517s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:22:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bdf3fd7f-7e1b-489b-b2e3-2915c9c27fbf tempest-VolumeDependencyTests-422894319 None] Lock "cinder-quobyte-9a3021c4-c2f1-4217-87f7-e8331c02eed0" released by "delete_snapshot" :: held 1.542s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:22:54 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-bdf3fd7f-7e1b-489b-b2e3-2915c9c27fbf tempest-VolumeDependencyTests-422894319 None] Created reservations ['30e94a82-8002-40b1-883b-9f74ceec836d', '7810d0e5-12e7-4510-bdf0-1c0855d062dc', 'c8a08790-2b34-44d8-b764-90a988923b7e', 'db9a4fd7-3c29-4b20-868f-89add5a0022c'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:22:54 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-bdf3fd7f-7e1b-489b-b2e3-2915c9c27fbf tempest-VolumeDependencyTests-422894319 None] Delete snapshot completed successfully. Sep 06 08:22:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bdf3fd7f-7e1b-489b-b2e3-2915c9c27fbf tempest-VolumeDependencyTests-422894319 None] Lock "cinder-351887f7-02ae-4917-bbab-26ac741573cf-delete_snapshot" released by "delete_snapshot" :: held 1.664s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:22:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9ec06bc3-a5e4-4356-b6bb-eaa3ed6776e3 tempest-VolumeDependencyTests-422894319 None] Acquiring lock "cinder-9a3021c4-c2f1-4217-87f7-e8331c02eed0-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:22:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9ec06bc3-a5e4-4356-b6bb-eaa3ed6776e3 tempest-VolumeDependencyTests-422894319 None] Lock "cinder-9a3021c4-c2f1-4217-87f7-e8331c02eed0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:22:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9ec06bc3-a5e4-4356-b6bb-eaa3ed6776e3 tempest-VolumeDependencyTests-422894319 None] Acquiring lock "cinder-quobyte-9a3021c4-c2f1-4217-87f7-e8331c02eed0" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:22:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9ec06bc3-a5e4-4356-b6bb-eaa3ed6776e3 tempest-VolumeDependencyTests-422894319 None] Lock "cinder-quobyte-9a3021c4-c2f1-4217-87f7-e8331c02eed0" acquired by "delete_volume" :: waited 0.016s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:22:54 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b01948-7d1e-48c5-8382-913fbbda6c49]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:22:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9ec06bc3-a5e4-4356-b6bb-eaa3ed6776e3 tempest-VolumeDependencyTests-422894319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:55 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0 Sep 06 08:22:55 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:55 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9ec06bc3-a5e4-4356-b6bb-eaa3ed6776e3 tempest-VolumeDependencyTests-422894319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0" returned: 0 in 0.350s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9ec06bc3-a5e4-4356-b6bb-eaa3ed6776e3 tempest-VolumeDependencyTests-422894319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:55 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0 Sep 06 08:22:55 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:55 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9ec06bc3-a5e4-4356-b6bb-eaa3ed6776e3 tempest-VolumeDependencyTests-422894319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9a3021c4-c2f1-4217-87f7-e8331c02eed0" returned: 0 in 0.235s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:55 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9ec06bc3-a5e4-4356-b6bb-eaa3ed6776e3 tempest-VolumeDependencyTests-422894319 None] Lock "cinder-quobyte-9a3021c4-c2f1-4217-87f7-e8331c02eed0" released by "delete_volume" :: held 0.640s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:22:55 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-9ec06bc3-a5e4-4356-b6bb-eaa3ed6776e3 tempest-VolumeDependencyTests-422894319 None] Created reservations ['b89271dc-082a-4a4c-a8dc-f5e19089926a', 'd636a26a-0e4e-4849-abd6-0e11b8a67757', '64156430-a708-4009-9f53-526e36ff4420', 'c7b33f14-da04-40bb-a217-649b80e465e7'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:22:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9ec06bc3-a5e4-4356-b6bb-eaa3ed6776e3 tempest-VolumeDependencyTests-422894319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:22:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9ec06bc3-a5e4-4356-b6bb-eaa3ed6776e3 tempest-VolumeDependencyTests-422894319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:22:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9ec06bc3-a5e4-4356-b6bb-eaa3ed6776e3 tempest-VolumeDependencyTests-422894319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:22:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9ec06bc3-a5e4-4356-b6bb-eaa3ed6776e3 tempest-VolumeDependencyTests-422894319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:22:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9ec06bc3-a5e4-4356-b6bb-eaa3ed6776e3 tempest-VolumeDependencyTests-422894319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:22:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9ec06bc3-a5e4-4356-b6bb-eaa3ed6776e3 tempest-VolumeDependencyTests-422894319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:55 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:22:55 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:55 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9ec06bc3-a5e4-4356-b6bb-eaa3ed6776e3 tempest-VolumeDependencyTests-422894319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.237s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:55 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-9ec06bc3-a5e4-4356-b6bb-eaa3ed6776e3 tempest-VolumeDependencyTests-422894319 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:22:55 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-9ec06bc3-a5e4-4356-b6bb-eaa3ed6776e3 tempest-VolumeDependencyTests-422894319 None] Deleted volume successfully. Sep 06 08:22:55 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9ec06bc3-a5e4-4356-b6bb-eaa3ed6776e3 tempest-VolumeDependencyTests-422894319 None] Lock "cinder-9a3021c4-c2f1-4217-87f7-e8331c02eed0-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:22:55 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2bbc2833-27ca-4553-ac2a-74db108f255a tempest-VolumeDependencyTests-422894319 None] Acquiring lock "cinder-538577cd-d061-4f8f-b2cd-280a572ad319-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:22:55 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2bbc2833-27ca-4553-ac2a-74db108f255a tempest-VolumeDependencyTests-422894319 None] Lock "cinder-538577cd-d061-4f8f-b2cd-280a572ad319-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:22:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2bbc2833-27ca-4553-ac2a-74db108f255a tempest-VolumeDependencyTests-422894319 None] Acquiring lock "cinder-quobyte-538577cd-d061-4f8f-b2cd-280a572ad319" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:22:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2bbc2833-27ca-4553-ac2a-74db108f255a tempest-VolumeDependencyTests-422894319 None] Lock "cinder-quobyte-538577cd-d061-4f8f-b2cd-280a572ad319" acquired by "delete_volume" :: waited 0.016s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:22:56 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1827a0f8-dec6-4609-b6db-e17bf6c97048]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:22:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2bbc2833-27ca-4553-ac2a-74db108f255a tempest-VolumeDependencyTests-422894319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-538577cd-d061-4f8f-b2cd-280a572ad319 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:56 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-538577cd-d061-4f8f-b2cd-280a572ad319 Sep 06 08:22:56 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:56 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2bbc2833-27ca-4553-ac2a-74db108f255a tempest-VolumeDependencyTests-422894319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-538577cd-d061-4f8f-b2cd-280a572ad319" returned: 0 in 0.351s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2bbc2833-27ca-4553-ac2a-74db108f255a tempest-VolumeDependencyTests-422894319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-538577cd-d061-4f8f-b2cd-280a572ad319 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:56 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-538577cd-d061-4f8f-b2cd-280a572ad319 Sep 06 08:22:56 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:56 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2bbc2833-27ca-4553-ac2a-74db108f255a tempest-VolumeDependencyTests-422894319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-538577cd-d061-4f8f-b2cd-280a572ad319" returned: 0 in 0.247s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2bbc2833-27ca-4553-ac2a-74db108f255a tempest-VolumeDependencyTests-422894319 None] Lock "cinder-quobyte-538577cd-d061-4f8f-b2cd-280a572ad319" released by "delete_volume" :: held 0.633s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:22:56 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-2bbc2833-27ca-4553-ac2a-74db108f255a tempest-VolumeDependencyTests-422894319 None] Created reservations ['76f77184-37b3-42ef-a30f-287a1d38cc0f', '373827cf-fe78-4f03-bb0c-d14736f0a6ca', '3147d747-d20f-424e-9642-a9f403bfd295', '13b922c2-5df1-4488-b159-04e5b19093bf'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:22:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2bbc2833-27ca-4553-ac2a-74db108f255a tempest-VolumeDependencyTests-422894319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:22:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2bbc2833-27ca-4553-ac2a-74db108f255a tempest-VolumeDependencyTests-422894319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:22:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2bbc2833-27ca-4553-ac2a-74db108f255a tempest-VolumeDependencyTests-422894319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:22:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2bbc2833-27ca-4553-ac2a-74db108f255a tempest-VolumeDependencyTests-422894319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:22:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2bbc2833-27ca-4553-ac2a-74db108f255a tempest-VolumeDependencyTests-422894319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:22:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2bbc2833-27ca-4553-ac2a-74db108f255a tempest-VolumeDependencyTests-422894319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:56 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:22:56 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:57 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2bbc2833-27ca-4553-ac2a-74db108f255a tempest-VolumeDependencyTests-422894319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.249s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:57 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-2bbc2833-27ca-4553-ac2a-74db108f255a tempest-VolumeDependencyTests-422894319 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:22:57 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-2bbc2833-27ca-4553-ac2a-74db108f255a tempest-VolumeDependencyTests-422894319 None] Deleted volume successfully. Sep 06 08:22:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2bbc2833-27ca-4553-ac2a-74db108f255a tempest-VolumeDependencyTests-422894319 None] Lock "cinder-538577cd-d061-4f8f-b2cd-280a572ad319-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:22:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:22:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:22:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:22:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:22:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:22:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:22:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:22:59 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:22:59 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:22:59 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Sep 06 08:22:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.252s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:22:59 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:22:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager._thread_info {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:22:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread count: 28 {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 08:22:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread info: [<_MainThread(MainThread, started 139985167040640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:23:06 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:UPDATE=44,cinder:SELECT=38,cinder:INSERT=16,cinder:DELETE=2 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:23:07 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=37,cinder:INSERT=14,cinder:UPDATE=39,cinder:DELETE=5 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Flow 'volume_create_manager' (8e6de253-cdad-483b-b20e-a5a99d9e1d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875654bb-0afc-488f-a9ed-000280f6ee38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875654bb-0afc-488f-a9ed-000280f6ee38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f470096e-7264-454c-9ab1-799dc9c56353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f665251d9a5a4f9089661d6fed3c830e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:13Z,use_quota=True,user_id='48c90f86e68246528629d25a7deea09e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99c2068-ba59-485c-b976-498f299f1c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99c2068-ba59-485c-b976-498f299f1c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d56782c7-b475-4453-97e7-c3c777e3c3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d56782c7-b475-4453-97e7-c3c777e3c3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f470096e-7264-454c-9ab1-799dc9c56353', 'volume_name': 'volume-f470096e-7264-454c-9ab1-799dc9c56353', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c302cdd-ffbc-41c1-96a4-4bb0eeba00f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c302cdd-ffbc-41c1-96a4-4bb0eeba00f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e96c32-356f-4125-bfe1-5990d7dcd092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:13 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Volume f470096e-7264-454c-9ab1-799dc9c56353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f470096e-7264-454c-9ab1-799dc9c56353', 'volume_size': 1} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f470096e-7264-454c-9ab1-799dc9c56353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f665251d9a5a4f9089661d6fed3c830e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:13Z,use_quota=True,user_id='48c90f86e68246528629d25a7deea09e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Creating volume f470096e-7264-454c-9ab1-799dc9c56353 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:23:13 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f470096e-7264-454c-9ab1-799dc9c56353 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:13 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f470096e-7264-454c-9ab1-799dc9c56353 1073741824 Sep 06 08:23:13 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Flow 'volume_create_manager' (df6c02fc-ea5a-452b-8b6d-1c84d43d49ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f961e852-2da3-443b-b4f8-854652a4ea28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f961e852-2da3-443b-b4f8-854652a4ea28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-166936829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818f51da-fc59-474c-a6e3-ea290afe2c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e69c9b46c14a44946577329537226d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:14Z,use_quota=True,user_id='0ba9896fbd364199a780dabbfd3a1957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37deeb2a-8f27-462c-852a-40458f9b67ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37deeb2a-8f27-462c-852a-40458f9b67ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078df50c-6840-4ad7-aba3-920a63c8c4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078df50c-6840-4ad7-aba3-920a63c8c4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '818f51da-fc59-474c-a6e3-ea290afe2c60', 'volume_name': 'volume-818f51da-fc59-474c-a6e3-ea290afe2c60', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b5dc84-fed3-4189-822a-47a487fc860c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b5dc84-fed3-4189-822a-47a487fc860c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f977571-1b99-4521-932c-b44dc5243af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:14 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Volume 818f51da-fc59-474c-a6e3-ea290afe2c60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-818f51da-fc59-474c-a6e3-ea290afe2c60', 'volume_size': 1} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Flow 'volume_create_manager' (07af179d-8894-4e51-9195-7be073aaef7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fad1e34-417b-40e6-9ca8-6b3ee6d4c669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fad1e34-417b-40e6-9ca8-6b3ee6d4c669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-448189741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c422c588-c632-46bd-9d77-61722e063527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e69c9b46c14a44946577329537226d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:14Z,use_quota=True,user_id='0ba9896fbd364199a780dabbfd3a1957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (234d4e49-3644-41e7-885f-a5dad0b0092b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (234d4e49-3644-41e7-885f-a5dad0b0092b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3337509d-2761-450c-bd31-1aca1aab32d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3337509d-2761-450c-bd31-1aca1aab32d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c422c588-c632-46bd-9d77-61722e063527', 'volume_name': 'volume-c422c588-c632-46bd-9d77-61722e063527', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd87314-1c22-4079-bf9b-98ee7fb95931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd87314-1c22-4079-bf9b-98ee7fb95931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32bf1987-18a1-4593-b01a-3c4d2b09a83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:14 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Volume c422c588-c632-46bd-9d77-61722e063527: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c422c588-c632-46bd-9d77-61722e063527', 'volume_size': 1} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:14 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f470096e-7264-454c-9ab1-799dc9c56353 1073741824" returned: 0 in 0.536s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f470096e-7264-454c-9ab1-799dc9c56353 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:14 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f470096e-7264-454c-9ab1-799dc9c56353 Sep 06 08:23:14 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:14 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f470096e-7264-454c-9ab1-799dc9c56353" returned: 0 in 0.357s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.767s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-166936829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818f51da-fc59-474c-a6e3-ea290afe2c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e69c9b46c14a44946577329537226d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:14Z,use_quota=True,user_id='0ba9896fbd364199a780dabbfd3a1957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Creating volume 818f51da-fc59-474c-a6e3-ea290afe2c60 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:23:14 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-818f51da-fc59-474c-a6e3-ea290afe2c60 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:14 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-818f51da-fc59-474c-a6e3-ea290afe2c60 1073741824 Sep 06 08:23:14 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e96c32-356f-4125-bfe1-5990d7dcd092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f470096e-7264-454c-9ab1-799dc9c56353', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153c2169-4ecc-4145-aad9-abbf8896baff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Flow 'volume_create_manager' (d0302e51-5cde-4a36-9c0b-ae3b88e4b77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8cc781a-8a48-4543-b95a-50793585aee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:14 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Volume volume-f470096e-7264-454c-9ab1-799dc9c56353 (f470096e-7264-454c-9ab1-799dc9c56353): created successfully Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153c2169-4ecc-4145-aad9-abbf8896baff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Flow 'volume_create_manager' (8e6de253-cdad-483b-b20e-a5a99d9e1d23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:14 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Flow 'volume_create_manager' (b2c15cc4-c732-4ea8-b33f-01d7332a037c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21da232c-325a-471a-aeed-4a76d63e62d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:15 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-af8d7752-401b-44b1-8acc-636f943fc9b6 tempest-CinderUnicodeTest-768898067 None] Created volume successfully. Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8cc781a-8a48-4543-b95a-50793585aee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1961863792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d88ed78-98cb-4a93-a45a-c6948d237022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e69c9b46c14a44946577329537226d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:15Z,use_quota=True,user_id='0ba9896fbd364199a780dabbfd3a1957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c56c7d-194d-4b24-a277-a3f4891aa7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c56c7d-194d-4b24-a277-a3f4891aa7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (286f582b-86d5-4e95-95d9-fbbcd83e679c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (286f582b-86d5-4e95-95d9-fbbcd83e679c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d88ed78-98cb-4a93-a45a-c6948d237022', 'volume_name': 'volume-0d88ed78-98cb-4a93-a45a-c6948d237022', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83bf1e9a-9d4c-40b8-aba5-79c1888fa337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83bf1e9a-9d4c-40b8-aba5-79c1888fa337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43403ba2-035a-4588-86c8-ac9b00452e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:15 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Volume 0d88ed78-98cb-4a93-a45a-c6948d237022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d88ed78-98cb-4a93-a45a-c6948d237022', 'volume_size': 1} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21da232c-325a-471a-aeed-4a76d63e62d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2049941960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9177bde6-8ff4-4afc-99af-75330f6d8773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57ff192bd0a74a27be0be1f1201231cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:15Z,use_quota=True,user_id='0f50a8b862534662bb877ccafabde4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b440000-4b98-42fb-a64c-b71d28244e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b440000-4b98-42fb-a64c-b71d28244e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7579b7de-f1d3-4c2e-9f8f-b0f94d5162dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7579b7de-f1d3-4c2e-9f8f-b0f94d5162dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9177bde6-8ff4-4afc-99af-75330f6d8773', 'volume_name': 'volume-9177bde6-8ff4-4afc-99af-75330f6d8773', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac4c5f4-fbfe-4bbb-9c08-c5f654f625f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac4c5f4-fbfe-4bbb-9c08-c5f654f625f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba3016b-9773-461a-94fe-58a6a0709e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:15 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Volume 9177bde6-8ff4-4afc-99af-75330f6d8773: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9177bde6-8ff4-4afc-99af-75330f6d8773', 'volume_size': 1} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Flow 'volume_create_manager' (3bc962c4-e354-4c84-9815-2a6ddf04a067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eab0e5a-1b82-4cd2-a1a4-4443588c4244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eab0e5a-1b82-4cd2-a1a4-4443588c4244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1672108487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf1b887-c971-43dd-b875-3425fc1ea5b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e69c9b46c14a44946577329537226d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:15Z,use_quota=True,user_id='0ba9896fbd364199a780dabbfd3a1957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee260b4-ad43-4580-962a-b45edd0fc1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee260b4-ad43-4580-962a-b45edd0fc1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b314b93b-a2b4-4cb5-a8ff-a10969a3c27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b314b93b-a2b4-4cb5-a8ff-a10969a3c27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cf1b887-c971-43dd-b875-3425fc1ea5b7', 'volume_name': 'volume-1cf1b887-c971-43dd-b875-3425fc1ea5b7', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:15 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a99da3-079b-4d53-9494-31666a0f3eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a99da3-079b-4d53-9494-31666a0f3eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9092114-2af5-46ed-bc8e-55556d46028b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:15 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Volume 1cf1b887-c971-43dd-b875-3425fc1ea5b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cf1b887-c971-43dd-b875-3425fc1ea5b7', 'volume_size': 1} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-818f51da-fc59-474c-a6e3-ea290afe2c60 1073741824" returned: 0 in 0.667s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-818f51da-fc59-474c-a6e3-ea290afe2c60 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:15 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-818f51da-fc59-474c-a6e3-ea290afe2c60 Sep 06 08:23:15 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Flow 'volume_create_manager' (f21fba78-9304-4628-8d56-0bbd2ebb801e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4db44b5-7ffa-406d-bb4c-3b5ebbf13b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4db44b5-7ffa-406d-bb4c-3b5ebbf13b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-15525314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e69c9b46c14a44946577329537226d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:16Z,use_quota=True,user_id='0ba9896fbd364199a780dabbfd3a1957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4293f7a0-d272-425e-a54d-614fc164c82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4293f7a0-d272-425e-a54d-614fc164c82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469b5155-960b-4aa6-b37e-41ac56f5fa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469b5155-960b-4aa6-b37e-41ac56f5fa6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3', 'volume_name': 'volume-2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (583c0088-78a5-4304-bdee-b504fb7fa8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (583c0088-78a5-4304-bdee-b504fb7fa8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d1599f-825e-4664-ab9c-576551b8c17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:15 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Volume 2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3', 'volume_size': 1} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:15 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-818f51da-fc59-474c-a6e3-ea290afe2c60" returned: 0 in 0.307s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.668s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-448189741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c422c588-c632-46bd-9d77-61722e063527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e69c9b46c14a44946577329537226d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:14Z,use_quota=True,user_id='0ba9896fbd364199a780dabbfd3a1957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Creating volume c422c588-c632-46bd-9d77-61722e063527 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:23:15 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c422c588-c632-46bd-9d77-61722e063527 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:15 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c422c588-c632-46bd-9d77-61722e063527 1073741824 Sep 06 08:23:15 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f977571-1b99-4521-932c-b44dc5243af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-818f51da-fc59-474c-a6e3-ea290afe2c60', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43d6979-5df0-451c-b5c6-4ac21ee2450b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:15 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Volume volume-818f51da-fc59-474c-a6e3-ea290afe2c60 (818f51da-fc59-474c-a6e3-ea290afe2c60): created successfully Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43d6979-5df0-451c-b5c6-4ac21ee2450b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Flow 'volume_create_manager' (df6c02fc-ea5a-452b-8b6d-1c84d43d49ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:15 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f9fdd2f5-ca68-41ee-8b88-ba1cb36eced1 tempest-CreateVolumesFromImageTest-1399067170 None] Created volume successfully. Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Flow 'volume_create_manager' (9da91a14-9e12-4990-b493-43eb93cf22b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:16 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d6ba6a-d2ef-4d95-bd66-d1a97a1cc916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c422c588-c632-46bd-9d77-61722e063527 1073741824" returned: 0 in 0.513s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d6ba6a-d2ef-4d95-bd66-d1a97a1cc916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1697413369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd53c815-f7a0-4fcd-b175-46ddde5fc31b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f665251d9a5a4f9089661d6fed3c830e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:16Z,use_quota=True,user_id='48c90f86e68246528629d25a7deea09e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d3f0cb-93cf-45f6-a881-781abb0c48cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d3f0cb-93cf-45f6-a881-781abb0c48cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (164ceaaa-d334-48f9-92f0-f54a241570f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (164ceaaa-d334-48f9-92f0-f54a241570f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd53c815-f7a0-4fcd-b175-46ddde5fc31b', 'volume_name': 'volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd5e6a6-fba7-4194-af46-94e408e06018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd5e6a6-fba7-4194-af46-94e408e06018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba14f0c-123c-49e0-97b4-ac67d420e349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:16 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Volume dd53c815-f7a0-4fcd-b175-46ddde5fc31b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b', 'volume_size': 1} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c422c588-c632-46bd-9d77-61722e063527 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:16 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c422c588-c632-46bd-9d77-61722e063527 Sep 06 08:23:16 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:16 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c422c588-c632-46bd-9d77-61722e063527" returned: 0 in 0.269s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.556s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1961863792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d88ed78-98cb-4a93-a45a-c6948d237022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e69c9b46c14a44946577329537226d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:15Z,use_quota=True,user_id='0ba9896fbd364199a780dabbfd3a1957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Creating volume 0d88ed78-98cb-4a93-a45a-c6948d237022 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:23:16 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0d88ed78-98cb-4a93-a45a-c6948d237022 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:16 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0d88ed78-98cb-4a93-a45a-c6948d237022 1073741824 Sep 06 08:23:16 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32bf1987-18a1-4593-b01a-3c4d2b09a83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c422c588-c632-46bd-9d77-61722e063527', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e55c2e3-f6ba-4496-ab12-23616acdac06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:16 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Volume volume-c422c588-c632-46bd-9d77-61722e063527 (c422c588-c632-46bd-9d77-61722e063527): created successfully Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e55c2e3-f6ba-4496-ab12-23616acdac06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:16 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Flow 'volume_create_manager' (07af179d-8894-4e51-9195-7be073aaef7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:16 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-5342baaa-14e7-4440-b6d8-64dee346f6d0 tempest-CreateVolumesFromImageTest-1399067170 None] Created volume successfully. Sep 06 08:23:17 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0d88ed78-98cb-4a93-a45a-c6948d237022 1073741824" returned: 0 in 0.453s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0d88ed78-98cb-4a93-a45a-c6948d237022 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:17 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0d88ed78-98cb-4a93-a45a-c6948d237022 Sep 06 08:23:17 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:17 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0d88ed78-98cb-4a93-a45a-c6948d237022" returned: 0 in 0.261s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.267s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2049941960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9177bde6-8ff4-4afc-99af-75330f6d8773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57ff192bd0a74a27be0be1f1201231cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:15Z,use_quota=True,user_id='0f50a8b862534662bb877ccafabde4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Creating volume 9177bde6-8ff4-4afc-99af-75330f6d8773 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:23:17 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43403ba2-035a-4588-86c8-ac9b00452e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d88ed78-98cb-4a93-a45a-c6948d237022', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:17 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773 1073741824 Sep 06 08:23:17 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba30f10-375c-411a-bf5b-82a1eef94273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:17 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Volume volume-0d88ed78-98cb-4a93-a45a-c6948d237022 (0d88ed78-98cb-4a93-a45a-c6948d237022): created successfully Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba30f10-375c-411a-bf5b-82a1eef94273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Flow 'volume_create_manager' (d0302e51-5cde-4a36-9c0b-ae3b88e4b77a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:17 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-aa7f68cf-5a0c-4700-a3db-e27cb594e47d tempest-CreateVolumesFromImageTest-1399067170 None] Created volume successfully. Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Flow 'volume_create_manager' (e506bcad-86cd-4ac9-928e-0fabff049216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (562986fd-ca6d-4efe-8ac0-5cd472c9c293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (562986fd-ca6d-4efe-8ac0-5cd472c9c293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95d5a8a46fe4bfa82e363e9d2f95e57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:18Z,use_quota=True,user_id='9e5e6d2dc4784ff3b9c3c94f436176d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8399c75f-b8a4-474a-abc7-46ae9b419ced),volume_type_id=8399c75f-b8a4-474a-abc7-46ae9b419ced)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb07137d-1767-4e98-a2ad-23e5d2011feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb07137d-1767-4e98-a2ad-23e5d2011feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82f5adb-281d-453c-840c-02985b836bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG cinder.image.glance [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Creating Keystone auth plugin from conf {{(pid=87307) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82f5adb-281d-453c-840c-02985b836bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d', 'volume_name': 'volume-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d', 'volume_size': 1, 'image_id': '591bcbb4-a9ac-4f2e-b74f-57dd101bcad5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/591bcbb4-a9ac-4f2e-b74f-57dd101bcad5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd9196302342274c924722d443e4c8c08', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c95d5a8a46fe4bfa82e363e9d2f95e57', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c596da4cd8ac8d4bde4ab0a27b55ba3ca37ee0f6be7a9a7a317821d1378c624c5d7f2fdd97227929c35f04ec8df180c37a83e06b0f2e55769e2bf6ebdeeeca1', 'id': '591bcbb4-a9ac-4f2e-b74f-57dd101bcad5', 'created_at': datetime.datetime(2026, 9, 6, 6, 23, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 6, 23, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/591bcbb4-a9ac-4f2e-b74f-57dd101bcad5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce402d7-a96e-4a5a-8a8e-5ba71f5681bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce402d7-a96e-4a5a-8a8e-5ba71f5681bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2770b39-20ec-4410-9652-6dbb3c622cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:17 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Volume bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d', 'volume_size': 1, 'image_id': '591bcbb4-a9ac-4f2e-b74f-57dd101bcad5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/591bcbb4-a9ac-4f2e-b74f-57dd101bcad5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd9196302342274c924722d443e4c8c08', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c95d5a8a46fe4bfa82e363e9d2f95e57', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c596da4cd8ac8d4bde4ab0a27b55ba3ca37ee0f6be7a9a7a317821d1378c624c5d7f2fdd97227929c35f04ec8df180c37a83e06b0f2e55769e2bf6ebdeeeca1', 'id': '591bcbb4-a9ac-4f2e-b74f-57dd101bcad5', 'created_at': datetime.datetime(2026, 9, 6, 6, 23, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 6, 23, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/591bcbb4-a9ac-4f2e-b74f-57dd101bcad5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Trying to clone bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d from image 591bcbb4-a9ac-4f2e-b74f-57dd101bcad5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/591bcbb4-a9ac-4f2e-b74f-57dd101bcad5', 'metadata': {}}]). {{(pid=87307) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 08:23:17 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773 1073741824" returned: 0 in 0.459s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:17 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773 Sep 06 08:23:17 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 08:23:18 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Image download 0.00 MB at 0.00 MB/s Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[739c4db5-25f6-454b-8e5f-d194468d4070]: (4, 'raw') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:18 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD Sep 06 08:23:18 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:18 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773" returned: 0 in 0.272s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.788s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1672108487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf1b887-c971-43dd-b875-3425fc1ea5b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e69c9b46c14a44946577329537226d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:15Z,use_quota=True,user_id='0ba9896fbd364199a780dabbfd3a1957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Creating volume 1cf1b887-c971-43dd-b875-3425fc1ea5b7 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:23:18 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-1cf1b887-c971-43dd-b875-3425fc1ea5b7 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:18 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-1cf1b887-c971-43dd-b875-3425fc1ea5b7 1073741824 Sep 06 08:23:18 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba3016b-9773-461a-94fe-58a6a0709e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9177bde6-8ff4-4afc-99af-75330f6d8773', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee9baec-57c8-434a-8204-f9a75d08bc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:18 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Volume volume-9177bde6-8ff4-4afc-99af-75330f6d8773 (9177bde6-8ff4-4afc-99af-75330f6d8773): created successfully Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee9baec-57c8-434a-8204-f9a75d08bc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Flow 'volume_create_manager' (b2c15cc4-c732-4ea8-b33f-01d7332a037c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:18 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-7a8127dd-7747-4b10-bd54-6e2b34fd0af5 tempest-ProjectMemberTests-219511464 None] Created volume successfully. Sep 06 08:23:18 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:18 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD Sep 06 08:23:18 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:18 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-1cf1b887-c971-43dd-b875-3425fc1ea5b7 1073741824" returned: 0 in 0.459s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-1cf1b887-c971-43dd-b875-3425fc1ea5b7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:18 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD" returned: 1 in 0.337s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD' failed. Not Retrying. {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Temporary image 591bcbb4-a9ac-4f2e-b74f-57dd101bcad5 is fetched for user 9e5e6d2dc4784ff3b9c3c94f436176d9. {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 08:23:18 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-1cf1b887-c971-43dd-b875-3425fc1ea5b7 Sep 06 08:23:18 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0152473e-2666-4ade-a59e-404f7794b677]: (4, 'raw') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:18 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD Sep 06 08:23:18 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:19 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-1cf1b887-c971-43dd-b875-3425fc1ea5b7" returned: 0 in 0.262s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.267s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-15525314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e69c9b46c14a44946577329537226d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:16Z,use_quota=True,user_id='0ba9896fbd364199a780dabbfd3a1957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Creating volume 2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:23:19 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9092114-2af5-46ed-bc8e-55556d46028b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cf1b887-c971-43dd-b875-3425fc1ea5b7', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:19 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3 1073741824 Sep 06 08:23:19 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04f6749-d188-4bae-b4db-98e6ef5b3ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:19 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Volume volume-1cf1b887-c971-43dd-b875-3425fc1ea5b7 (1cf1b887-c971-43dd-b875-3425fc1ea5b7): created successfully Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04f6749-d188-4bae-b4db-98e6ef5b3ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Flow 'volume_create_manager' (3bc962c4-e354-4c84-9815-2a6ddf04a067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:19 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f956211a-8877-4cc0-b1b8-805ff93c6ba0 tempest-CreateVolumesFromImageTest-1399067170 None] Created volume successfully. Sep 06 08:23:19 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD" returned: 0 in 0.386s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9df910d2-7cac-4315-85a2-5f11be312c3d tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:19 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD Sep 06 08:23:19 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:19 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3 1073741824" returned: 0 in 0.450s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:19 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3 Sep 06 08:23:19 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:19 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD" returned: 1 in 0.352s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD' failed. Not Retrying. {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:19 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3" returned: 0 in 0.252s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.386s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1697413369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd53c815-f7a0-4fcd-b175-46ddde5fc31b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f665251d9a5a4f9089661d6fed3c830e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:16Z,use_quota=True,user_id='48c90f86e68246528629d25a7deea09e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Creating volume dd53c815-f7a0-4fcd-b175-46ddde5fc31b {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:23:19 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d1599f-825e-4664-ab9c-576551b8c17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:19 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b 1073741824 Sep 06 08:23:19 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f551264b-3d20-4a26-bf90-c96f6d4adc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:19 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Volume volume-2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3 (2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3): created successfully Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f551264b-3d20-4a26-bf90-c96f6d4adc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Flow 'volume_create_manager' (f21fba78-9304-4628-8d56-0bbd2ebb801e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:19 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f06ce413-1941-4aef-80ff-ac8c3070e7fa tempest-CreateVolumesFromImageTest-1399067170 None] Created volume successfully. Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bc570141-bd0b-4b60-a54f-07a64faf73ab tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "cinder-2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bc570141-bd0b-4b60-a54f-07a64faf73ab tempest-CreateVolumesFromImageTest-1399067170 None] Lock "cinder-2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bc570141-bd0b-4b60-a54f-07a64faf73ab tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "cinder-quobyte-2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bc570141-bd0b-4b60-a54f-07a64faf73ab tempest-CreateVolumesFromImageTest-1399067170 None] Lock "cinder-quobyte-2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3" acquired by "delete_volume" :: waited 0.019s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e82f435-0694-4fb3-8eb5-cdc489578cf9]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc570141-bd0b-4b60-a54f-07a64faf73ab tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:20 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b 1073741824" returned: 0 in 0.460s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:20 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3 Sep 06 08:23:20 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:20 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b Sep 06 08:23:20 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:20 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b" returned: 0 in 0.245s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9df910d2-7cac-4315-85a2-5f11be312c3d tempest-ProjectMemberTests-219511464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.205s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:20 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc570141-bd0b-4b60-a54f-07a64faf73ab tempest-CreateVolumesFromImageTest-1399067170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3" returned: 0 in 0.396s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc570141-bd0b-4b60-a54f-07a64faf73ab tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba14f0c-123c-49e0-97b4-ac67d420e349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac13df6-a5d4-469d-93a1-0348f9e22ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:20 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3 Sep 06 08:23:20 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-9df910d2-7cac-4315-85a2-5f11be312c3d tempest-ProjectMemberTests-219511464 None] Creating offline snapshot 632878ff-555c-4f80-8685-f23791c85e84 of volume 9177bde6-8ff4-4afc-99af-75330f6d8773 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[416ff0bf-2225-4bb8-a439-31fb81a0d479]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9df910d2-7cac-4315-85a2-5f11be312c3d tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:20 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Volume volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b (dd53c815-f7a0-4fcd-b175-46ddde5fc31b): created successfully Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac13df6-a5d4-469d-93a1-0348f9e22ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Flow 'volume_create_manager' (9da91a14-9e12-4990-b493-43eb93cf22b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:20 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-a7d8c175-aba0-4ed1-9ef0-8d74aee608f1 tempest-CinderUnicodeTest-768898067 None] Created volume successfully. Sep 06 08:23:20 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773 Sep 06 08:23:20 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:20 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc570141-bd0b-4b60-a54f-07a64faf73ab tempest-CreateVolumesFromImageTest-1399067170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3" returned: 0 in 0.246s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bc570141-bd0b-4b60-a54f-07a64faf73ab tempest-CreateVolumesFromImageTest-1399067170 None] Lock "cinder-quobyte-2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3" released by "delete_volume" :: held 0.686s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-bc570141-bd0b-4b60-a54f-07a64faf73ab tempest-CreateVolumesFromImageTest-1399067170 None] Created reservations ['c082d8c5-b0ed-4d51-950e-43de4c708cc7', '05020299-5558-49cb-8112-392873a6cefd', '8790a25e-fb36-4325-9f6a-b160ef5187fc', '2bf84019-d78b-4862-ad76-7e8c8cd0872e'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bc570141-bd0b-4b60-a54f-07a64faf73ab tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bc570141-bd0b-4b60-a54f-07a64faf73ab tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bc570141-bd0b-4b60-a54f-07a64faf73ab tempest-CreateVolumesFromImageTest-1399067170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bc570141-bd0b-4b60-a54f-07a64faf73ab tempest-CreateVolumesFromImageTest-1399067170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bc570141-bd0b-4b60-a54f-07a64faf73ab tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc570141-bd0b-4b60-a54f-07a64faf73ab tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:20 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:23:20 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:20 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9df910d2-7cac-4315-85a2-5f11be312c3d tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773" returned: 0 in 0.384s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9df910d2-7cac-4315-85a2-5f11be312c3d tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.632878ff-555c-4f80-8685-f23791c85e84 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:21 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.632878ff-555c-4f80-8685-f23791c85e84 1G Sep 06 08:23:21 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:21 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bc570141-bd0b-4b60-a54f-07a64faf73ab tempest-CreateVolumesFromImageTest-1399067170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.266s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:21 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-bc570141-bd0b-4b60-a54f-07a64faf73ab tempest-CreateVolumesFromImageTest-1399067170 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:23:21 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-bc570141-bd0b-4b60-a54f-07a64faf73ab tempest-CreateVolumesFromImageTest-1399067170 None] Deleted volume successfully. Sep 06 08:23:21 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bc570141-bd0b-4b60-a54f-07a64faf73ab tempest-CreateVolumesFromImageTest-1399067170 None] Lock "cinder-2535e388-38fe-4fcf-a5ab-7d9c0cb8a3c3-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:21 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4e0f43ad-8a8e-4d98-b3e4-3331fe76a11e tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "cinder-1cf1b887-c971-43dd-b875-3425fc1ea5b7-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:21 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4e0f43ad-8a8e-4d98-b3e4-3331fe76a11e tempest-CreateVolumesFromImageTest-1399067170 None] Lock "cinder-1cf1b887-c971-43dd-b875-3425fc1ea5b7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:21 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4e0f43ad-8a8e-4d98-b3e4-3331fe76a11e tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "cinder-quobyte-1cf1b887-c971-43dd-b875-3425fc1ea5b7" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:21 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4e0f43ad-8a8e-4d98-b3e4-3331fe76a11e tempest-CreateVolumesFromImageTest-1399067170 None] Lock "cinder-quobyte-1cf1b887-c971-43dd-b875-3425fc1ea5b7" acquired by "delete_volume" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:21 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ed6c7a-1d26-42f4-8f65-3579141b259b]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4e0f43ad-8a8e-4d98-b3e4-3331fe76a11e tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-1cf1b887-c971-43dd-b875-3425fc1ea5b7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:21 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9df910d2-7cac-4315-85a2-5f11be312c3d tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.632878ff-555c-4f80-8685-f23791c85e84 1G" returned: 0 in 0.452s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9df910d2-7cac-4315-85a2-5f11be312c3d tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9177bde6-8ff4-4afc-99af-75330f6d8773 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.632878ff-555c-4f80-8685-f23791c85e84 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:21 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-1cf1b887-c971-43dd-b875-3425fc1ea5b7 Sep 06 08:23:21 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:21 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9177bde6-8ff4-4afc-99af-75330f6d8773 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.632878ff-555c-4f80-8685-f23791c85e84 Sep 06 08:23:21 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:21 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4e0f43ad-8a8e-4d98-b3e4-3331fe76a11e tempest-CreateVolumesFromImageTest-1399067170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-1cf1b887-c971-43dd-b875-3425fc1ea5b7" returned: 0 in 0.407s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4e0f43ad-8a8e-4d98-b3e4-3331fe76a11e tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-1cf1b887-c971-43dd-b875-3425fc1ea5b7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:21 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-1cf1b887-c971-43dd-b875-3425fc1ea5b7 Sep 06 08:23:21 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:21 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9df910d2-7cac-4315-85a2-5f11be312c3d tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9177bde6-8ff4-4afc-99af-75330f6d8773 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.632878ff-555c-4f80-8685-f23791c85e84" returned: 0 in 0.358s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:21 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-9df910d2-7cac-4315-85a2-5f11be312c3d tempest-ProjectMemberTests-219511464 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.632878ff-555c-4f80-8685-f23791c85e84 is being set with open permissions: ugo+rw Sep 06 08:23:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9df910d2-7cac-4315-85a2-5f11be312c3d tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.632878ff-555c-4f80-8685-f23791c85e84 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:21 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.632878ff-555c-4f80-8685-f23791c85e84 Sep 06 08:23:21 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b0bba8c3-4c6f-411b-bcf1-5c7339a55d80 tempest-CinderUnicodeTest-768898067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:21 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4e0f43ad-8a8e-4d98-b3e4-3331fe76a11e tempest-CreateVolumesFromImageTest-1399067170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-1cf1b887-c971-43dd-b875-3425fc1ea5b7" returned: 0 in 0.266s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4e0f43ad-8a8e-4d98-b3e4-3331fe76a11e tempest-CreateVolumesFromImageTest-1399067170 None] Lock "cinder-quobyte-1cf1b887-c971-43dd-b875-3425fc1ea5b7" released by "delete_volume" :: held 0.717s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-4e0f43ad-8a8e-4d98-b3e4-3331fe76a11e tempest-CreateVolumesFromImageTest-1399067170 None] Created reservations ['df05db64-7786-49d5-99ff-d7a764fb59c4', '6c9691ed-2287-4bea-a526-34b7d34c47c4', 'ff92db0d-1b3d-473d-85f0-8af22f8b9a9a', '0655cf54-6a8c-4dd9-b5a1-fff4ad16da61'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:23:22 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9df910d2-7cac-4315-85a2-5f11be312c3d tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.632878ff-555c-4f80-8685-f23791c85e84" returned: 0 in 0.293s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-4e0f43ad-8a8e-4d98-b3e4-3331fe76a11e tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-4e0f43ad-8a8e-4d98-b3e4-3331fe76a11e tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-4e0f43ad-8a8e-4d98-b3e4-3331fe76a11e tempest-CreateVolumesFromImageTest-1399067170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-4e0f43ad-8a8e-4d98-b3e4-3331fe76a11e tempest-CreateVolumesFromImageTest-1399067170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-4e0f43ad-8a8e-4d98-b3e4-3331fe76a11e tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4e0f43ad-8a8e-4d98-b3e4-3331fe76a11e tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9df910d2-7cac-4315-85a2-5f11be312c3d tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:22 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:23:22 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:22 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.info Sep 06 08:23:22 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:22 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3a7a11ed-23cc-41c1-a068-3e1a2d68f6aa tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "cinder-0d88ed78-98cb-4a93-a45a-c6948d237022-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4e0f43ad-8a8e-4d98-b3e4-3331fe76a11e tempest-CreateVolumesFromImageTest-1399067170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.282s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-4e0f43ad-8a8e-4d98-b3e4-3331fe76a11e tempest-CreateVolumesFromImageTest-1399067170 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:23:22 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:22 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-4e0f43ad-8a8e-4d98-b3e4-3331fe76a11e tempest-CreateVolumesFromImageTest-1399067170 None] Deleted volume successfully. Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9df910d2-7cac-4315-85a2-5f11be312c3d tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.info" returned: 0 in 0.287s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:22 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-9df910d2-7cac-4315-85a2-5f11be312c3d tempest-ProjectMemberTests-219511464 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.info is being set with open permissions: ugo+rw Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9df910d2-7cac-4315-85a2-5f11be312c3d tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3a7a11ed-23cc-41c1-a068-3e1a2d68f6aa tempest-CreateVolumesFromImageTest-1399067170 None] Lock "cinder-0d88ed78-98cb-4a93-a45a-c6948d237022-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:22 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.info Sep 06 08:23:22 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4e0f43ad-8a8e-4d98-b3e4-3331fe76a11e tempest-CreateVolumesFromImageTest-1399067170 None] Lock "cinder-1cf1b887-c971-43dd-b875-3425fc1ea5b7-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3a7a11ed-23cc-41c1-a068-3e1a2d68f6aa tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "cinder-quobyte-0d88ed78-98cb-4a93-a45a-c6948d237022" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3a7a11ed-23cc-41c1-a068-3e1a2d68f6aa tempest-CreateVolumesFromImageTest-1399067170 None] Lock "cinder-quobyte-0d88ed78-98cb-4a93-a45a-c6948d237022" acquired by "delete_volume" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc253c8-2a0c-44bd-b68f-1596ac9b402c]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3a7a11ed-23cc-41c1-a068-3e1a2d68f6aa tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0d88ed78-98cb-4a93-a45a-c6948d237022 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:22 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0d88ed78-98cb-4a93-a45a-c6948d237022 Sep 06 08:23:22 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:22 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9df910d2-7cac-4315-85a2-5f11be312c3d tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.info" returned: 0 in 0.262s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9df910d2-7cac-4315-85a2-5f11be312c3d tempest-ProjectMemberTests-219511464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.186s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.111s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95d5a8a46fe4bfa82e363e9d2f95e57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:18Z,use_quota=True,user_id='9e5e6d2dc4784ff3b9c3c94f436176d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8399c75f-b8a4-474a-abc7-46ae9b419ced),volume_type_id=8399c75f-b8a4-474a-abc7-46ae9b419ced)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Creating volume bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:23:22 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:22 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d 1073741824 Sep 06 08:23:22 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:22 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-9df910d2-7cac-4315-85a2-5f11be312c3d tempest-ProjectMemberTests-219511464 None] Create snapshot completed successfully Sep 06 08:23:22 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3a7a11ed-23cc-41c1-a068-3e1a2d68f6aa tempest-CreateVolumesFromImageTest-1399067170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0d88ed78-98cb-4a93-a45a-c6948d237022" returned: 0 in 0.383s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3a7a11ed-23cc-41c1-a068-3e1a2d68f6aa tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0d88ed78-98cb-4a93-a45a-c6948d237022 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:22 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0d88ed78-98cb-4a93-a45a-c6948d237022 Sep 06 08:23:22 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:23 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d 1073741824" returned: 0 in 0.424s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:23 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3a7a11ed-23cc-41c1-a068-3e1a2d68f6aa tempest-CreateVolumesFromImageTest-1399067170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0d88ed78-98cb-4a93-a45a-c6948d237022" returned: 0 in 0.291s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:23 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d Sep 06 08:23:23 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3a7a11ed-23cc-41c1-a068-3e1a2d68f6aa tempest-CreateVolumesFromImageTest-1399067170 None] Lock "cinder-quobyte-0d88ed78-98cb-4a93-a45a-c6948d237022" released by "delete_volume" :: held 0.715s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-3a7a11ed-23cc-41c1-a068-3e1a2d68f6aa tempest-CreateVolumesFromImageTest-1399067170 None] Created reservations ['1c783e66-09a9-46d3-935a-99613db7528f', 'dc5214ef-67f3-40cf-bb70-c3ceb5c535fa', '5cdc3ae8-02b6-48fd-bdcc-ead4cf812169', 'dc6e55a8-75de-4884-ab0c-955b67264acb'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3a7a11ed-23cc-41c1-a068-3e1a2d68f6aa tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3a7a11ed-23cc-41c1-a068-3e1a2d68f6aa tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3a7a11ed-23cc-41c1-a068-3e1a2d68f6aa tempest-CreateVolumesFromImageTest-1399067170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3a7a11ed-23cc-41c1-a068-3e1a2d68f6aa tempest-CreateVolumesFromImageTest-1399067170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3a7a11ed-23cc-41c1-a068-3e1a2d68f6aa tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3a7a11ed-23cc-41c1-a068-3e1a2d68f6aa tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:23 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:23:23 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:23 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d" returned: 0 in 0.248s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b0bba8c3-4c6f-411b-bcf1-5c7339a55d80 tempest-CinderUnicodeTest-768898067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.543s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-b0bba8c3-4c6f-411b-bcf1-5c7339a55d80 tempest-CinderUnicodeTest-768898067 None] Creating offline snapshot 65683e0f-57c0-4527-a891-762a3d704ead of volume dd53c815-f7a0-4fcd-b175-46ddde5fc31b {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Attempting download of 591bcbb4-a9ac-4f2e-b74f-57dd101bcad5 ((None, [{'url': 'file:///opt/stack/data/glance/images/591bcbb4-a9ac-4f2e-b74f-57dd101bcad5', 'metadata': {}}])) to volume bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d. {{(pid=87307) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4dbef067-78a6-486f-8c4d-34914010ad18 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-632878ff-555c-4f80-8685-f23791c85e84-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f4b1ee-7b03-43cf-ac4e-998333398ed0]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b0bba8c3-4c6f-411b-bcf1-5c7339a55d80 tempest-CinderUnicodeTest-768898067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4dbef067-78a6-486f-8c4d-34914010ad18 tempest-ProjectMemberTests-219511464 None] Lock "cinder-632878ff-555c-4f80-8685-f23791c85e84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4dbef067-78a6-486f-8c4d-34914010ad18 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-9177bde6-8ff4-4afc-99af-75330f6d8773" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4dbef067-78a6-486f-8c4d-34914010ad18 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-9177bde6-8ff4-4afc-99af-75330f6d8773" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4dbef067-78a6-486f-8c4d-34914010ad18 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-632878ff-555c-4f80-8685-f23791c85e84" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84b863f-a649-45c7-8dd5-94943bef1ef2]: (4, 'raw') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e2f7d994-f253-4e54-92cc-745f787b5e36 tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "cinder-c422c588-c632-46bd-9d77-61722e063527-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_phj45pi8 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4dbef067-78a6-486f-8c4d-34914010ad18 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-632878ff-555c-4f80-8685-f23791c85e84" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-4dbef067-78a6-486f-8c4d-34914010ad18 tempest-ProjectMemberTests-219511464 None] Deleting offline snapshot 632878ff-555c-4f80-8685-f23791c85e84 of volume 9177bde6-8ff4-4afc-99af-75330f6d8773 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:23:23 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-4dbef067-78a6-486f-8c4d-34914010ad18 tempest-ProjectMemberTests-219511464 None] snapshot_file for this snap is: volume-9177bde6-8ff4-4afc-99af-75330f6d8773.632878ff-555c-4f80-8685-f23791c85e84 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3a7a11ed-23cc-41c1-a068-3e1a2d68f6aa tempest-CreateVolumesFromImageTest-1399067170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.337s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-3a7a11ed-23cc-41c1-a068-3e1a2d68f6aa tempest-CreateVolumesFromImageTest-1399067170 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e2f7d994-f253-4e54-92cc-745f787b5e36 tempest-CreateVolumesFromImageTest-1399067170 None] Lock "cinder-c422c588-c632-46bd-9d77-61722e063527-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5522a406-14cf-4969-8564-17b6ccbcc65f]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4dbef067-78a6-486f-8c4d-34914010ad18 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.632878ff-555c-4f80-8685-f23791c85e84 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:23 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b Sep 06 08:23:23 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:23 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-3a7a11ed-23cc-41c1-a068-3e1a2d68f6aa tempest-CreateVolumesFromImageTest-1399067170 None] Deleted volume successfully. Sep 06 08:23:23 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_phj45pi8 Sep 06 08:23:23 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3a7a11ed-23cc-41c1-a068-3e1a2d68f6aa tempest-CreateVolumesFromImageTest-1399067170 None] Lock "cinder-0d88ed78-98cb-4a93-a45a-c6948d237022-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e2f7d994-f253-4e54-92cc-745f787b5e36 tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "cinder-quobyte-c422c588-c632-46bd-9d77-61722e063527" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e2f7d994-f253-4e54-92cc-745f787b5e36 tempest-CreateVolumesFromImageTest-1399067170 None] Lock "cinder-quobyte-c422c588-c632-46bd-9d77-61722e063527" acquired by "delete_volume" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[855f34f4-c34e-4aad-a38a-34527251246f]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e2f7d994-f253-4e54-92cc-745f787b5e36 tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c422c588-c632-46bd-9d77-61722e063527 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:23 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.632878ff-555c-4f80-8685-f23791c85e84 Sep 06 08:23:23 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:23 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c422c588-c632-46bd-9d77-61722e063527 Sep 06 08:23:23 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:24 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b0bba8c3-4c6f-411b-bcf1-5c7339a55d80 tempest-CinderUnicodeTest-768898067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b" returned: 0 in 0.501s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b0bba8c3-4c6f-411b-bcf1-5c7339a55d80 tempest-CinderUnicodeTest-768898067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.65683e0f-57c0-4527-a891-762a3d704ead 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:24 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_phj45pi8" returned: 0 in 0.441s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_phj45pi8 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:24 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.65683e0f-57c0-4527-a891-762a3d704ead 1G Sep 06 08:23:24 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:24 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4dbef067-78a6-486f-8c4d-34914010ad18 tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.632878ff-555c-4f80-8685-f23791c85e84" returned: 0 in 0.457s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-4dbef067-78a6-486f-8c4d-34914010ad18 tempest-ProjectMemberTests-219511464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9177bde6-8ff4-4afc-99af-75330f6d8773(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:23:24 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_phj45pi8 Sep 06 08:23:24 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[382f841b-32ae-45dd-a8f4-bf0fa08b9233]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4dbef067-78a6-486f-8c4d-34914010ad18 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:24 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e2f7d994-f253-4e54-92cc-745f787b5e36 tempest-CreateVolumesFromImageTest-1399067170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c422c588-c632-46bd-9d77-61722e063527" returned: 0 in 0.410s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e2f7d994-f253-4e54-92cc-745f787b5e36 tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c422c588-c632-46bd-9d77-61722e063527 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:24 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c422c588-c632-46bd-9d77-61722e063527 Sep 06 08:23:24 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:24 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773 Sep 06 08:23:24 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:24 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_phj45pi8" returned: 1 in 0.360s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_phj45pi8' failed. Not Retrying. {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[af613dc6-adc4-4a94-a3e9-836348a98a52]: (4, 'raw') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:24 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:24 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b0bba8c3-4c6f-411b-bcf1-5c7339a55d80 tempest-CinderUnicodeTest-768898067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.65683e0f-57c0-4527-a891-762a3d704ead 1G" returned: 0 in 0.469s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e2f7d994-f253-4e54-92cc-745f787b5e36 tempest-CreateVolumesFromImageTest-1399067170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c422c588-c632-46bd-9d77-61722e063527" returned: 0 in 0.284s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b0bba8c3-4c6f-411b-bcf1-5c7339a55d80 tempest-CinderUnicodeTest-768898067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.65683e0f-57c0-4527-a891-762a3d704ead {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:24 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.65683e0f-57c0-4527-a891-762a3d704ead Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e2f7d994-f253-4e54-92cc-745f787b5e36 tempest-CreateVolumesFromImageTest-1399067170 None] Lock "cinder-quobyte-c422c588-c632-46bd-9d77-61722e063527" released by "delete_volume" :: held 0.755s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:24 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:24 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD Sep 06 08:23:24 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-e2f7d994-f253-4e54-92cc-745f787b5e36 tempest-CreateVolumesFromImageTest-1399067170 None] Created reservations ['a9975fea-bb7b-4011-a125-aa062022d592', 'd0ecf5b2-477c-4070-9b44-c66b0f0767aa', '75b6087e-44df-4118-97c3-c59214047ee4', '14770d02-e5d5-4161-960c-82711967f820'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:23:24 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4dbef067-78a6-486f-8c4d-34914010ad18 tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773" returned: 0 in 0.489s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4dbef067-78a6-486f-8c4d-34914010ad18 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.632878ff-555c-4f80-8685-f23791c85e84 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:24 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.632878ff-555c-4f80-8685-f23791c85e84 Sep 06 08:23:24 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e2f7d994-f253-4e54-92cc-745f787b5e36 tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e2f7d994-f253-4e54-92cc-745f787b5e36 tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e2f7d994-f253-4e54-92cc-745f787b5e36 tempest-CreateVolumesFromImageTest-1399067170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e2f7d994-f253-4e54-92cc-745f787b5e36 tempest-CreateVolumesFromImageTest-1399067170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e2f7d994-f253-4e54-92cc-745f787b5e36 tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e2f7d994-f253-4e54-92cc-745f787b5e36 tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:24 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD" returned: 0 in 0.381s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:24 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:23:24 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-04050bc6-1eaf-4eae-a3bf-0c28995faa54 tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "cinder-818f51da-fc59-474c-a6e3-ea290afe2c60-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-04050bc6-1eaf-4eae-a3bf-0c28995faa54 tempest-CreateVolumesFromImageTest-1399067170 None] Lock "cinder-818f51da-fc59-474c-a6e3-ea290afe2c60-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:24 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b0bba8c3-4c6f-411b-bcf1-5c7339a55d80 tempest-CinderUnicodeTest-768898067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.65683e0f-57c0-4527-a891-762a3d704ead" returned: 0 in 0.452s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:24 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-b0bba8c3-4c6f-411b-bcf1-5c7339a55d80 tempest-CinderUnicodeTest-768898067 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.65683e0f-57c0-4527-a891-762a3d704ead is being set with open permissions: ugo+rw Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b0bba8c3-4c6f-411b-bcf1-5c7339a55d80 tempest-CinderUnicodeTest-768898067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.65683e0f-57c0-4527-a891-762a3d704ead {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:24 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD Sep 06 08:23:24 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:24 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-04050bc6-1eaf-4eae-a3bf-0c28995faa54 tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "cinder-quobyte-818f51da-fc59-474c-a6e3-ea290afe2c60" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-04050bc6-1eaf-4eae-a3bf-0c28995faa54 tempest-CreateVolumesFromImageTest-1399067170 None] Lock "cinder-quobyte-818f51da-fc59-474c-a6e3-ea290afe2c60" acquired by "delete_volume" :: waited 0.032s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:25 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.65683e0f-57c0-4527-a891-762a3d704ead Sep 06 08:23:25 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d55531d-4657-4094-912c-d32c47ade4da]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-04050bc6-1eaf-4eae-a3bf-0c28995faa54 tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-818f51da-fc59-474c-a6e3-ea290afe2c60 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:25 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e2f7d994-f253-4e54-92cc-745f787b5e36 tempest-CreateVolumesFromImageTest-1399067170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.398s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-e2f7d994-f253-4e54-92cc-745f787b5e36 tempest-CreateVolumesFromImageTest-1399067170 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:23:25 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e2f7d994-f253-4e54-92cc-745f787b5e36 tempest-CreateVolumesFromImageTest-1399067170 None] Deleted volume successfully. Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e2f7d994-f253-4e54-92cc-745f787b5e36 tempest-CreateVolumesFromImageTest-1399067170 None] Lock "cinder-c422c588-c632-46bd-9d77-61722e063527-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:25 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-818f51da-fc59-474c-a6e3-ea290afe2c60 Sep 06 08:23:25 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:25 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD" returned: 1 in 0.452s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD' failed. Not Retrying. {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] 591bcbb4-a9ac-4f2e-b74f-57dd101bcad5 was raw, converting to qcow2 {{(pid=87307) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:25 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:25 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4dbef067-78a6-486f-8c4d-34914010ad18 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.632878ff-555c-4f80-8685-f23791c85e84" returned: 0 in 0.623s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:25 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4dbef067-78a6-486f-8c4d-34914010ad18 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.632878ff-555c-4f80-8685-f23791c85e84 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:25 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.632878ff-555c-4f80-8685-f23791c85e84 Sep 06 08:23:25 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:25 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b0bba8c3-4c6f-411b-bcf1-5c7339a55d80 tempest-CinderUnicodeTest-768898067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.65683e0f-57c0-4527-a891-762a3d704ead" returned: 0 in 0.431s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b0bba8c3-4c6f-411b-bcf1-5c7339a55d80 tempest-CinderUnicodeTest-768898067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:25 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.info Sep 06 08:23:25 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:25 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-04050bc6-1eaf-4eae-a3bf-0c28995faa54 tempest-CreateVolumesFromImageTest-1399067170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-818f51da-fc59-474c-a6e3-ea290afe2c60" returned: 0 in 0.480s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-04050bc6-1eaf-4eae-a3bf-0c28995faa54 tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-818f51da-fc59-474c-a6e3-ea290afe2c60 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:25 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-818f51da-fc59-474c-a6e3-ea290afe2c60 Sep 06 08:23:25 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:25 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4dbef067-78a6-486f-8c4d-34914010ad18 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773.632878ff-555c-4f80-8685-f23791c85e84" returned: 0 in 0.288s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4dbef067-78a6-486f-8c4d-34914010ad18 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-632878ff-555c-4f80-8685-f23791c85e84" released by "_delete_snapshot" :: held 2.017s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4dbef067-78a6-486f-8c4d-34914010ad18 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-9177bde6-8ff4-4afc-99af-75330f6d8773" released by "delete_snapshot" :: held 2.087s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:25 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b0bba8c3-4c6f-411b-bcf1-5c7339a55d80 tempest-CinderUnicodeTest-768898067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.info" returned: 0 in 0.285s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:25 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-b0bba8c3-4c6f-411b-bcf1-5c7339a55d80 tempest-CinderUnicodeTest-768898067 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.info is being set with open permissions: ugo+rw Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b0bba8c3-4c6f-411b-bcf1-5c7339a55d80 tempest-CinderUnicodeTest-768898067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:25 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.info Sep 06 08:23:25 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-4dbef067-78a6-486f-8c4d-34914010ad18 tempest-ProjectMemberTests-219511464 None] Created reservations ['c1dde13f-0092-4291-a7b4-cfdd2a3c7373', '7ef54268-c4b3-4b58-be44-ab454171c044', '866cf6ca-0a22-4569-ada0-cf7a70338839', '01031e72-76c6-40e8-b233-8711da6f78f0'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:23:25 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-4dbef067-78a6-486f-8c4d-34914010ad18 tempest-ProjectMemberTests-219511464 None] Delete snapshot completed successfully. Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4dbef067-78a6-486f-8c4d-34914010ad18 tempest-ProjectMemberTests-219511464 None] Lock "cinder-632878ff-555c-4f80-8685-f23791c85e84-delete_snapshot" released by "delete_snapshot" :: held 2.281s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:25 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d" returned: 0 in 0.572s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_591bcbb4-a9ac-4f2e-b74f-57dd101bcad5_fh7buf86devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:23:25 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Converted 0.00 MB image at 0.00 MB/s Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:25 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-04050bc6-1eaf-4eae-a3bf-0c28995faa54 tempest-CreateVolumesFromImageTest-1399067170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-818f51da-fc59-474c-a6e3-ea290afe2c60" returned: 0 in 0.314s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:25 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d 1G Sep 06 08:23:25 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-04050bc6-1eaf-4eae-a3bf-0c28995faa54 tempest-CreateVolumesFromImageTest-1399067170 None] Lock "cinder-quobyte-818f51da-fc59-474c-a6e3-ea290afe2c60" released by "delete_volume" :: held 0.853s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-04050bc6-1eaf-4eae-a3bf-0c28995faa54 tempest-CreateVolumesFromImageTest-1399067170 None] Created reservations ['33d89a8c-554d-4fb1-af41-e4489cced5f5', '3d84ad71-4a50-43d3-9111-8c0931451725', '8dc22b9e-061d-4157-aa09-540b8bad76df', '9686aadc-c5b2-4e50-8999-558924d336e7'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-04050bc6-1eaf-4eae-a3bf-0c28995faa54 tempest-CreateVolumesFromImageTest-1399067170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-04050bc6-1eaf-4eae-a3bf-0c28995faa54 tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-04050bc6-1eaf-4eae-a3bf-0c28995faa54 tempest-CreateVolumesFromImageTest-1399067170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-04050bc6-1eaf-4eae-a3bf-0c28995faa54 tempest-CreateVolumesFromImageTest-1399067170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-04050bc6-1eaf-4eae-a3bf-0c28995faa54 tempest-CreateVolumesFromImageTest-1399067170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-04050bc6-1eaf-4eae-a3bf-0c28995faa54 tempest-CreateVolumesFromImageTest-1399067170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:25 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b0bba8c3-4c6f-411b-bcf1-5c7339a55d80 tempest-CinderUnicodeTest-768898067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.info" returned: 0 in 0.304s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:26 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:23:26 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b0bba8c3-4c6f-411b-bcf1-5c7339a55d80 tempest-CinderUnicodeTest-768898067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.591s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:26 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-b0bba8c3-4c6f-411b-bcf1-5c7339a55d80 tempest-CinderUnicodeTest-768898067 None] Create snapshot completed successfully Sep 06 08:23:26 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d 1G" returned: 0 in 0.380s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:26 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Downloaded image 591bcbb4-a9ac-4f2e-b74f-57dd101bcad5 ((None, [{'url': 'file:///opt/stack/data/glance/images/591bcbb4-a9ac-4f2e-b74f-57dd101bcad5', 'metadata': {}}])) to volume bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d successfully. {{(pid=87307) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 08:23:26 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Temporary image 591bcbb4-a9ac-4f2e-b74f-57dd101bcad5 for user 9e5e6d2dc4784ff3b9c3c94f436176d9 is deleted. {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 08:23:26 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Marking volume bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d as bootable. {{(pid=87307) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 08:23:26 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Copying metadata from image 591bcbb4-a9ac-4f2e-b74f-57dd101bcad5 to bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d. {{(pid=87307) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 08:23:26 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Creating volume glance metadata for volume bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d backed by image 591bcbb4-a9ac-4f2e-b74f-57dd101bcad5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '591bcbb4-a9ac-4f2e-b74f-57dd101bcad5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd9196302342274c924722d443e4c8c08', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87307) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 08:23:26 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-04050bc6-1eaf-4eae-a3bf-0c28995faa54 tempest-CreateVolumesFromImageTest-1399067170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.285s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:26 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-04050bc6-1eaf-4eae-a3bf-0c28995faa54 tempest-CreateVolumesFromImageTest-1399067170 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:23:26 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-04050bc6-1eaf-4eae-a3bf-0c28995faa54 tempest-CreateVolumesFromImageTest-1399067170 None] Deleted volume successfully. Sep 06 08:23:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-04050bc6-1eaf-4eae-a3bf-0c28995faa54 tempest-CreateVolumesFromImageTest-1399067170 None] Lock "cinder-818f51da-fc59-474c-a6e3-ea290afe2c60-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2770b39-20ec-4410-9652-6dbb3c622cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d', 'volume_size': 1, 'image_id': '591bcbb4-a9ac-4f2e-b74f-57dd101bcad5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/591bcbb4-a9ac-4f2e-b74f-57dd101bcad5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd9196302342274c924722d443e4c8c08', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c95d5a8a46fe4bfa82e363e9d2f95e57', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c596da4cd8ac8d4bde4ab0a27b55ba3ca37ee0f6be7a9a7a317821d1378c624c5d7f2fdd97227929c35f04ec8df180c37a83e06b0f2e55769e2bf6ebdeeeca1', 'id': '591bcbb4-a9ac-4f2e-b74f-57dd101bcad5', 'created_at': datetime.datetime(2026, 9, 6, 6, 23, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 6, 23, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/591bcbb4-a9ac-4f2e-b74f-57dd101bcad5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77aabf9e-3453-4ffd-af3d-1fa6ed163ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:26 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Volume volume-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d (bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d): created successfully Sep 06 08:23:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77aabf9e-3453-4ffd-af3d-1fa6ed163ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Flow 'volume_create_manager' (e506bcad-86cd-4ac9-928e-0fabff049216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:26 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-ee25715d-9041-4efc-bd63-ac7371f8ab1b tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Created volume successfully. Sep 06 08:23:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-45651c88-6945-47b5-ad4e-6fa5adecbe01 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-9177bde6-8ff4-4afc-99af-75330f6d8773-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-45651c88-6945-47b5-ad4e-6fa5adecbe01 tempest-ProjectMemberTests-219511464 None] Lock "cinder-9177bde6-8ff4-4afc-99af-75330f6d8773-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-45651c88-6945-47b5-ad4e-6fa5adecbe01 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-9177bde6-8ff4-4afc-99af-75330f6d8773" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-45651c88-6945-47b5-ad4e-6fa5adecbe01 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-9177bde6-8ff4-4afc-99af-75330f6d8773" acquired by "delete_volume" :: waited 0.023s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:26 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1abeb85-74af-437b-a936-7ae3ef49987e]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45651c88-6945-47b5-ad4e-6fa5adecbe01 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:27 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773 Sep 06 08:23:27 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9517cb5f-6a16-4ca5-b951-13d489da38c0 tempest-CinderUnicodeTest-768898067 None] Acquiring lock "cinder-65683e0f-57c0-4527-a891-762a3d704ead-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9517cb5f-6a16-4ca5-b951-13d489da38c0 tempest-CinderUnicodeTest-768898067 None] Lock "cinder-65683e0f-57c0-4527-a891-762a3d704ead-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9517cb5f-6a16-4ca5-b951-13d489da38c0 tempest-CinderUnicodeTest-768898067 None] Acquiring lock "cinder-quobyte-dd53c815-f7a0-4fcd-b175-46ddde5fc31b" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9517cb5f-6a16-4ca5-b951-13d489da38c0 tempest-CinderUnicodeTest-768898067 None] Lock "cinder-quobyte-dd53c815-f7a0-4fcd-b175-46ddde5fc31b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9517cb5f-6a16-4ca5-b951-13d489da38c0 tempest-CinderUnicodeTest-768898067 None] Acquiring lock "cinder-quobyte-65683e0f-57c0-4527-a891-762a3d704ead" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9517cb5f-6a16-4ca5-b951-13d489da38c0 tempest-CinderUnicodeTest-768898067 None] Lock "cinder-quobyte-65683e0f-57c0-4527-a891-762a3d704ead" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-9517cb5f-6a16-4ca5-b951-13d489da38c0 tempest-CinderUnicodeTest-768898067 None] Deleting offline snapshot 65683e0f-57c0-4527-a891-762a3d704ead of volume dd53c815-f7a0-4fcd-b175-46ddde5fc31b {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-9517cb5f-6a16-4ca5-b951-13d489da38c0 tempest-CinderUnicodeTest-768898067 None] snapshot_file for this snap is: volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.65683e0f-57c0-4527-a891-762a3d704ead {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-653c7de5-bf10-46ae-afdf-f6112e00f7b1 tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Acquiring lock "cinder-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c99f53a-87da-44b3-97ff-b95b6701b38d]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9517cb5f-6a16-4ca5-b951-13d489da38c0 tempest-CinderUnicodeTest-768898067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.65683e0f-57c0-4527-a891-762a3d704ead {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:27 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-653c7de5-bf10-46ae-afdf-f6112e00f7b1 tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Lock "cinder-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45651c88-6945-47b5-ad4e-6fa5adecbe01 tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773" returned: 0 in 0.513s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45651c88-6945-47b5-ad4e-6fa5adecbe01 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:27 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773 Sep 06 08:23:27 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-653c7de5-bf10-46ae-afdf-f6112e00f7b1 tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Acquiring lock "cinder-quobyte-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-653c7de5-bf10-46ae-afdf-f6112e00f7b1 tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Lock "cinder-quobyte-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d" acquired by "delete_volume" :: waited 0.022s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2de788b-eea9-495b-bd11-943e91a92fec]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-653c7de5-bf10-46ae-afdf-f6112e00f7b1 tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:27 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.65683e0f-57c0-4527-a891-762a3d704ead Sep 06 08:23:27 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:27 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d Sep 06 08:23:27 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:27 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45651c88-6945-47b5-ad4e-6fa5adecbe01 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-9177bde6-8ff4-4afc-99af-75330f6d8773" returned: 0 in 0.303s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-45651c88-6945-47b5-ad4e-6fa5adecbe01 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-9177bde6-8ff4-4afc-99af-75330f6d8773" released by "delete_volume" :: held 0.881s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-45651c88-6945-47b5-ad4e-6fa5adecbe01 tempest-ProjectMemberTests-219511464 None] Created reservations ['71f158a7-0eb7-4ed8-b727-cbc91e378cf6', '12c89c0e-9a00-4a61-8693-2132777e1530', '6eb7a5a1-088d-4063-83d6-ecdde51c50f5', '0667862c-ba1c-4afc-a282-4f2b4357c694'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:23:27 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9517cb5f-6a16-4ca5-b951-13d489da38c0 tempest-CinderUnicodeTest-768898067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.65683e0f-57c0-4527-a891-762a3d704ead" returned: 0 in 0.536s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-9517cb5f-6a16-4ca5-b951-13d489da38c0 tempest-CinderUnicodeTest-768898067 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-45651c88-6945-47b5-ad4e-6fa5adecbe01 tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-45651c88-6945-47b5-ad4e-6fa5adecbe01 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-45651c88-6945-47b5-ad4e-6fa5adecbe01 tempest-ProjectMemberTests-219511464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-45651c88-6945-47b5-ad4e-6fa5adecbe01 tempest-ProjectMemberTests-219511464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-45651c88-6945-47b5-ad4e-6fa5adecbe01 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45651c88-6945-47b5-ad4e-6fa5adecbe01 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[013b55d9-ff48-49a4-9aa6-824e9666e521]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9517cb5f-6a16-4ca5-b951-13d489da38c0 tempest-CinderUnicodeTest-768898067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:27 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:27 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:23:27 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-653c7de5-bf10-46ae-afdf-f6112e00f7b1 tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d" returned: 0 in 0.486s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-653c7de5-bf10-46ae-afdf-f6112e00f7b1 tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:28 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d Sep 06 08:23:28 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:28 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b Sep 06 08:23:28 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:28 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45651c88-6945-47b5-ad4e-6fa5adecbe01 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.492s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-45651c88-6945-47b5-ad4e-6fa5adecbe01 tempest-ProjectMemberTests-219511464 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:23:28 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-653c7de5-bf10-46ae-afdf-f6112e00f7b1 tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d" returned: 0 in 0.446s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:28 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-45651c88-6945-47b5-ad4e-6fa5adecbe01 tempest-ProjectMemberTests-219511464 None] Deleted volume successfully. Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-653c7de5-bf10-46ae-afdf-f6112e00f7b1 tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Lock "cinder-quobyte-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d" released by "delete_volume" :: held 1.013s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-45651c88-6945-47b5-ad4e-6fa5adecbe01 tempest-ProjectMemberTests-219511464 None] Lock "cinder-9177bde6-8ff4-4afc-99af-75330f6d8773-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:28 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9517cb5f-6a16-4ca5-b951-13d489da38c0 tempest-CinderUnicodeTest-768898067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b" returned: 0 in 0.572s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9517cb5f-6a16-4ca5-b951-13d489da38c0 tempest-CinderUnicodeTest-768898067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.65683e0f-57c0-4527-a891-762a3d704ead {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:23:28 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.65683e0f-57c0-4527-a891-762a3d704ead Sep 06 08:23:28 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Flow 'volume_create_manager' (94b66580-57b9-4226-a129-1da9b8955f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5242706-a850-4360-9e9c-f4c80a2ecd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5242706-a850-4360-9e9c-f4c80a2ecd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1110026727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542cd372-ed58-45b8-9453-0076364ffe08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57ff192bd0a74a27be0be1f1201231cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:29Z,use_quota=True,user_id='0f50a8b862534662bb877ccafabde4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (296cdedd-ae48-4a9c-8c95-5016c08dfd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (296cdedd-ae48-4a9c-8c95-5016c08dfd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d806f71-063c-46d2-b56b-0c60926738d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d806f71-063c-46d2-b56b-0c60926738d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '542cd372-ed58-45b8-9453-0076364ffe08', 'volume_name': 'volume-542cd372-ed58-45b8-9453-0076364ffe08', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (633a2878-8e6c-45b6-b0e7-54f1ec351627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (633a2878-8e6c-45b6-b0e7-54f1ec351627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7360342-e240-4bc2-9190-b07e8c988ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:28 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Volume 542cd372-ed58-45b8-9453-0076364ffe08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-542cd372-ed58-45b8-9453-0076364ffe08', 'volume_size': 1} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1110026727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542cd372-ed58-45b8-9453-0076364ffe08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57ff192bd0a74a27be0be1f1201231cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:29Z,use_quota=True,user_id='0f50a8b862534662bb877ccafabde4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Creating volume 542cd372-ed58-45b8-9453-0076364ffe08 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:23:28 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-653c7de5-bf10-46ae-afdf-f6112e00f7b1 tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Created reservations ['4a88585f-7a7f-4841-96d6-1e08a58ecc50', '2ab37227-ac41-4aee-9864-96e45e74c91a', '2f354ce5-dd9f-43b0-ac18-bf8b12412dec', 'a186d434-4801-4ac0-8a75-55e3063ff7e8'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:23:28 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08 1073741824 Sep 06 08:23:28 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-653c7de5-bf10-46ae-afdf-f6112e00f7b1 tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-653c7de5-bf10-46ae-afdf-f6112e00f7b1 tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-653c7de5-bf10-46ae-afdf-f6112e00f7b1 tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-653c7de5-bf10-46ae-afdf-f6112e00f7b1 tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-653c7de5-bf10-46ae-afdf-f6112e00f7b1 tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-653c7de5-bf10-46ae-afdf-f6112e00f7b1 tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:28 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:23:28 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:28 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9517cb5f-6a16-4ca5-b951-13d489da38c0 tempest-CinderUnicodeTest-768898067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.65683e0f-57c0-4527-a891-762a3d704ead" returned: 0 in 0.400s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9517cb5f-6a16-4ca5-b951-13d489da38c0 tempest-CinderUnicodeTest-768898067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.65683e0f-57c0-4527-a891-762a3d704ead {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:28 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.65683e0f-57c0-4527-a891-762a3d704ead Sep 06 08:23:28 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:29 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-653c7de5-bf10-46ae-afdf-f6112e00f7b1 tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.286s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-653c7de5-bf10-46ae-afdf-f6112e00f7b1 tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:23:29 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-653c7de5-bf10-46ae-afdf-f6112e00f7b1 tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Deleted volume successfully. Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-653c7de5-bf10-46ae-afdf-f6112e00f7b1 tempest-VolumeAndVolumeTypeFromImageTest-2023599917 None] Lock "cinder-bf0e86e7-c1fc-4854-b019-4e4ab05d4f0d-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:29 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08 1073741824" returned: 0 in 0.563s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:29 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9517cb5f-6a16-4ca5-b951-13d489da38c0 tempest-CinderUnicodeTest-768898067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b.65683e0f-57c0-4527-a891-762a3d704ead" returned: 0 in 0.320s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:29 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08 Sep 06 08:23:29 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9517cb5f-6a16-4ca5-b951-13d489da38c0 tempest-CinderUnicodeTest-768898067 None] Lock "cinder-quobyte-65683e0f-57c0-4527-a891-762a3d704ead" released by "_delete_snapshot" :: held 2.025s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9517cb5f-6a16-4ca5-b951-13d489da38c0 tempest-CinderUnicodeTest-768898067 None] Lock "cinder-quobyte-dd53c815-f7a0-4fcd-b175-46ddde5fc31b" released by "delete_snapshot" :: held 2.054s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-9517cb5f-6a16-4ca5-b951-13d489da38c0 tempest-CinderUnicodeTest-768898067 None] Created reservations ['82e117ab-ea8f-4e7f-ab21-c32f4f73feb5', '395a6a2c-1852-4697-b780-ea8f816670b7', '79d65067-f944-42a9-a51a-9f93c7367f97', 'd1e32bee-6883-42fa-b1f3-2656551c41ea'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:23:29 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-9517cb5f-6a16-4ca5-b951-13d489da38c0 tempest-CinderUnicodeTest-768898067 None] Delete snapshot completed successfully. Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-9517cb5f-6a16-4ca5-b951-13d489da38c0 tempest-CinderUnicodeTest-768898067 None] Lock "cinder-65683e0f-57c0-4527-a891-762a3d704ead-delete_snapshot" released by "delete_snapshot" :: held 2.263s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:29 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08" returned: 0 in 0.307s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7360342-e240-4bc2-9190-b07e8c988ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-542cd372-ed58-45b8-9453-0076364ffe08', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df51989e-77a1-4bb8-809e-fa35d356b08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:29 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Volume volume-542cd372-ed58-45b8-9453-0076364ffe08 (542cd372-ed58-45b8-9453-0076364ffe08): created successfully Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df51989e-77a1-4bb8-809e-fa35d356b08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Flow 'volume_create_manager' (94b66580-57b9-4226-a129-1da9b8955f40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:29 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-47394033-b064-4685-ab5e-ac7cbf7c9a95 tempest-ProjectMemberTests-219511464 None] Created volume successfully. Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Flow 'volume_create_manager' (f2335c68-7499-4d63-a3b8-04043f6062fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e17276b-199e-4af3-9903-93a774cb2c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e17276b-199e-4af3-9903-93a774cb2c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1352206904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55dc11ad-5e8f-4279-8d43-91ba88b23702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86c2f6a0832476db07e76d952d40352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:30Z,use_quota=True,user_id='5c8017528ccf48b6b25fa5ef9cbd55d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84275c3-33ff-4750-98bf-f50682ef6b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84275c3-33ff-4750-98bf-f50682ef6b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bb3dbf-400c-4d20-8fdb-1ba5e2b3fe1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bb3dbf-400c-4d20-8fdb-1ba5e2b3fe1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55dc11ad-5e8f-4279-8d43-91ba88b23702', 'volume_name': 'volume-55dc11ad-5e8f-4279-8d43-91ba88b23702', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25e10fb-d0c4-4606-a074-14bb3b2fae5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25e10fb-d0c4-4606-a074-14bb3b2fae5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e4f325-339b-4927-9e4e-dd08a595c834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:29 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Volume 55dc11ad-5e8f-4279-8d43-91ba88b23702: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55dc11ad-5e8f-4279-8d43-91ba88b23702', 'volume_size': 1} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1352206904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55dc11ad-5e8f-4279-8d43-91ba88b23702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86c2f6a0832476db07e76d952d40352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:30Z,use_quota=True,user_id='5c8017528ccf48b6b25fa5ef9cbd55d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Creating volume 55dc11ad-5e8f-4279-8d43-91ba88b23702 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:23:29 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:23:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:29 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702 1073741824 Sep 06 08:23:29 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:30 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702 1073741824" returned: 0 in 0.443s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:30 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702 Sep 06 08:23:30 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:30 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702" returned: 0 in 0.251s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:30 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:23:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e4f325-339b-4927-9e4e-dd08a595c834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55dc11ad-5e8f-4279-8d43-91ba88b23702', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4361b975-b69d-4efc-8f24-24f21c79863e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:30 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Volume volume-55dc11ad-5e8f-4279-8d43-91ba88b23702 (55dc11ad-5e8f-4279-8d43-91ba88b23702): created successfully Sep 06 08:23:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4361b975-b69d-4efc-8f24-24f21c79863e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:30 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Flow 'volume_create_manager' (f2335c68-7499-4d63-a3b8-04043f6062fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:30 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bfa5fa06-5b5c-405c-8a79-fedee9c115db tempest-CinderUnicodeTest-768898067 None] Acquiring lock "cinder-dd53c815-f7a0-4fcd-b175-46ddde5fc31b-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:30 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-90adac96-6802-42ab-b424-36eb88015d52 tempest-VolumeDependencyTests-369377781 None] Created volume successfully. Sep 06 08:23:30 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bfa5fa06-5b5c-405c-8a79-fedee9c115db tempest-CinderUnicodeTest-768898067 None] Lock "cinder-dd53c815-f7a0-4fcd-b175-46ddde5fc31b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:30 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bfa5fa06-5b5c-405c-8a79-fedee9c115db tempest-CinderUnicodeTest-768898067 None] Acquiring lock "cinder-quobyte-dd53c815-f7a0-4fcd-b175-46ddde5fc31b" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:30 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bfa5fa06-5b5c-405c-8a79-fedee9c115db tempest-CinderUnicodeTest-768898067 None] Lock "cinder-quobyte-dd53c815-f7a0-4fcd-b175-46ddde5fc31b" acquired by "delete_volume" :: waited 0.022s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:30 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2cc3cb-900d-424c-815d-068897f9e53e]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bfa5fa06-5b5c-405c-8a79-fedee9c115db tempest-CinderUnicodeTest-768898067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e6fde827-f120-4147-9a2c-5e36d77386c1 tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e6fde827-f120-4147-9a2c-5e36d77386c1 tempest-ProjectMemberTests-219511464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:30 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-e6fde827-f120-4147-9a2c-5e36d77386c1 tempest-ProjectMemberTests-219511464 None] Creating offline snapshot 2c539730-6280-4aae-9bad-5302d50087ce of volume 542cd372-ed58-45b8-9453-0076364ffe08 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:23:30 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb32dd0-64f2-4ae7-9b1b-736fddae9b1e]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e6fde827-f120-4147-9a2c-5e36d77386c1 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:30 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b Sep 06 08:23:30 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:31 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08 Sep 06 08:23:31 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9b97fcaa-6d03-4352-af6f-02eac27e3ba7 tempest-VolumeDependencyTests-369377781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:31 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bfa5fa06-5b5c-405c-8a79-fedee9c115db tempest-CinderUnicodeTest-768898067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b" returned: 0 in 0.496s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bfa5fa06-5b5c-405c-8a79-fedee9c115db tempest-CinderUnicodeTest-768898067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:31 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b Sep 06 08:23:31 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:31 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e6fde827-f120-4147-9a2c-5e36d77386c1 tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08" returned: 0 in 0.470s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e6fde827-f120-4147-9a2c-5e36d77386c1 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.2c539730-6280-4aae-9bad-5302d50087ce 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:31 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.2c539730-6280-4aae-9bad-5302d50087ce 1G Sep 06 08:23:31 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:31 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bfa5fa06-5b5c-405c-8a79-fedee9c115db tempest-CinderUnicodeTest-768898067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-dd53c815-f7a0-4fcd-b175-46ddde5fc31b" returned: 0 in 0.281s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bfa5fa06-5b5c-405c-8a79-fedee9c115db tempest-CinderUnicodeTest-768898067 None] Lock "cinder-quobyte-dd53c815-f7a0-4fcd-b175-46ddde5fc31b" released by "delete_volume" :: held 0.898s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:31 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-bfa5fa06-5b5c-405c-8a79-fedee9c115db tempest-CinderUnicodeTest-768898067 None] Created reservations ['1b136d52-e2cf-4fa1-bb89-6d82db34eeff', '90c2693d-d4cc-45f0-a732-4697073b5c80', '8ef690e3-335d-448a-9378-8107d289b6d9', 'e0334126-48a7-4037-999f-078631143e6c'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:23:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bfa5fa06-5b5c-405c-8a79-fedee9c115db tempest-CinderUnicodeTest-768898067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bfa5fa06-5b5c-405c-8a79-fedee9c115db tempest-CinderUnicodeTest-768898067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bfa5fa06-5b5c-405c-8a79-fedee9c115db tempest-CinderUnicodeTest-768898067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-bfa5fa06-5b5c-405c-8a79-fedee9c115db tempest-CinderUnicodeTest-768898067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-bfa5fa06-5b5c-405c-8a79-fedee9c115db tempest-CinderUnicodeTest-768898067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bfa5fa06-5b5c-405c-8a79-fedee9c115db tempest-CinderUnicodeTest-768898067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:31 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:23:31 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:31 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e6fde827-f120-4147-9a2c-5e36d77386c1 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.2c539730-6280-4aae-9bad-5302d50087ce 1G" returned: 0 in 0.522s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e6fde827-f120-4147-9a2c-5e36d77386c1 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-542cd372-ed58-45b8-9453-0076364ffe08 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.2c539730-6280-4aae-9bad-5302d50087ce {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-fa2759e1-de23-4852-bbef-c4c467783be9 tempest-CinderUnicodeTest-768898067 None] Acquiring lock "cinder-f470096e-7264-454c-9ab1-799dc9c56353-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:31 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-542cd372-ed58-45b8-9453-0076364ffe08 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.2c539730-6280-4aae-9bad-5302d50087ce Sep 06 08:23:31 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-fa2759e1-de23-4852-bbef-c4c467783be9 tempest-CinderUnicodeTest-768898067 None] Lock "cinder-f470096e-7264-454c-9ab1-799dc9c56353-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:32 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-fa2759e1-de23-4852-bbef-c4c467783be9 tempest-CinderUnicodeTest-768898067 None] Acquiring lock "cinder-quobyte-f470096e-7264-454c-9ab1-799dc9c56353" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:32 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-fa2759e1-de23-4852-bbef-c4c467783be9 tempest-CinderUnicodeTest-768898067 None] Lock "cinder-quobyte-f470096e-7264-454c-9ab1-799dc9c56353" acquired by "delete_volume" :: waited 0.061s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:32 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c215d92-22d4-4e4d-90b0-e043e74a0689]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-fa2759e1-de23-4852-bbef-c4c467783be9 tempest-CinderUnicodeTest-768898067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f470096e-7264-454c-9ab1-799dc9c56353 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:32 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-bfa5fa06-5b5c-405c-8a79-fedee9c115db tempest-CinderUnicodeTest-768898067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.457s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:32 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-bfa5fa06-5b5c-405c-8a79-fedee9c115db tempest-CinderUnicodeTest-768898067 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:23:32 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-bfa5fa06-5b5c-405c-8a79-fedee9c115db tempest-CinderUnicodeTest-768898067 None] Deleted volume successfully. Sep 06 08:23:32 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-bfa5fa06-5b5c-405c-8a79-fedee9c115db tempest-CinderUnicodeTest-768898067 None] Lock "cinder-dd53c815-f7a0-4fcd-b175-46ddde5fc31b-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:32 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e6fde827-f120-4147-9a2c-5e36d77386c1 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-542cd372-ed58-45b8-9453-0076364ffe08 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.2c539730-6280-4aae-9bad-5302d50087ce" returned: 0 in 0.412s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:32 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-e6fde827-f120-4147-9a2c-5e36d77386c1 tempest-ProjectMemberTests-219511464 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.2c539730-6280-4aae-9bad-5302d50087ce is being set with open permissions: ugo+rw Sep 06 08:23:32 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f470096e-7264-454c-9ab1-799dc9c56353 Sep 06 08:23:32 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e6fde827-f120-4147-9a2c-5e36d77386c1 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.2c539730-6280-4aae-9bad-5302d50087ce {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:32 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.2c539730-6280-4aae-9bad-5302d50087ce Sep 06 08:23:32 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:32 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e6fde827-f120-4147-9a2c-5e36d77386c1 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.2c539730-6280-4aae-9bad-5302d50087ce" returned: 0 in 0.260s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:32 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-fa2759e1-de23-4852-bbef-c4c467783be9 tempest-CinderUnicodeTest-768898067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f470096e-7264-454c-9ab1-799dc9c56353" returned: 0 in 0.442s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-fa2759e1-de23-4852-bbef-c4c467783be9 tempest-CinderUnicodeTest-768898067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f470096e-7264-454c-9ab1-799dc9c56353 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e6fde827-f120-4147-9a2c-5e36d77386c1 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:32 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f470096e-7264-454c-9ab1-799dc9c56353 Sep 06 08:23:32 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:32 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.info Sep 06 08:23:32 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:32 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-fa2759e1-de23-4852-bbef-c4c467783be9 tempest-CinderUnicodeTest-768898067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f470096e-7264-454c-9ab1-799dc9c56353" returned: 0 in 0.276s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:32 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-fa2759e1-de23-4852-bbef-c4c467783be9 tempest-CinderUnicodeTest-768898067 None] Lock "cinder-quobyte-f470096e-7264-454c-9ab1-799dc9c56353" released by "delete_volume" :: held 0.787s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:32 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e6fde827-f120-4147-9a2c-5e36d77386c1 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.info" returned: 0 in 0.298s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:32 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-e6fde827-f120-4147-9a2c-5e36d77386c1 tempest-ProjectMemberTests-219511464 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.info is being set with open permissions: ugo+rw Sep 06 08:23:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e6fde827-f120-4147-9a2c-5e36d77386c1 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:32 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.info Sep 06 08:23:32 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:32 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-fa2759e1-de23-4852-bbef-c4c467783be9 tempest-CinderUnicodeTest-768898067 None] Created reservations ['56eb0d40-2085-49c8-a4ef-abaa4cf91d93', '0436b4d8-c99a-4cc4-96ae-a5dbe3360c07', 'c262c6d3-b345-4ff2-820c-1d8f296f1edc', 'ebab58f8-adc4-4611-9faa-68567c7c1fb4'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:23:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-fa2759e1-de23-4852-bbef-c4c467783be9 tempest-CinderUnicodeTest-768898067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-fa2759e1-de23-4852-bbef-c4c467783be9 tempest-CinderUnicodeTest-768898067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-fa2759e1-de23-4852-bbef-c4c467783be9 tempest-CinderUnicodeTest-768898067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-fa2759e1-de23-4852-bbef-c4c467783be9 tempest-CinderUnicodeTest-768898067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-fa2759e1-de23-4852-bbef-c4c467783be9 tempest-CinderUnicodeTest-768898067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-fa2759e1-de23-4852-bbef-c4c467783be9 tempest-CinderUnicodeTest-768898067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:33 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:23:33 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:33 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e6fde827-f120-4147-9a2c-5e36d77386c1 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.info" returned: 0 in 0.264s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e6fde827-f120-4147-9a2c-5e36d77386c1 tempest-ProjectMemberTests-219511464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.354s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9b97fcaa-6d03-4352-af6f-02eac27e3ba7 tempest-VolumeDependencyTests-369377781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.084s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-9b97fcaa-6d03-4352-af6f-02eac27e3ba7 tempest-VolumeDependencyTests-369377781 None] Creating offline snapshot 391354b8-5732-4dc2-9785-aa4be9f8044d of volume 55dc11ad-5e8f-4279-8d43-91ba88b23702 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:23:33 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abb1a02-17ee-46f0-90ee-af66de50f1ee]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9b97fcaa-6d03-4352-af6f-02eac27e3ba7 tempest-VolumeDependencyTests-369377781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:33 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e6fde827-f120-4147-9a2c-5e36d77386c1 tempest-ProjectMemberTests-219511464 None] Create snapshot completed successfully Sep 06 08:23:33 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-fa2759e1-de23-4852-bbef-c4c467783be9 tempest-CinderUnicodeTest-768898067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.357s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:33 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-fa2759e1-de23-4852-bbef-c4c467783be9 tempest-CinderUnicodeTest-768898067 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:23:33 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-fa2759e1-de23-4852-bbef-c4c467783be9 tempest-CinderUnicodeTest-768898067 None] Deleted volume successfully. Sep 06 08:23:33 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702 Sep 06 08:23:33 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-fa2759e1-de23-4852-bbef-c4c467783be9 tempest-CinderUnicodeTest-768898067 None] Lock "cinder-f470096e-7264-454c-9ab1-799dc9c56353-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:33 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:33 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9b97fcaa-6d03-4352-af6f-02eac27e3ba7 tempest-VolumeDependencyTests-369377781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702" returned: 0 in 0.402s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9b97fcaa-6d03-4352-af6f-02eac27e3ba7 tempest-VolumeDependencyTests-369377781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.391354b8-5732-4dc2-9785-aa4be9f8044d 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:33 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.391354b8-5732-4dc2-9785-aa4be9f8044d 1G Sep 06 08:23:33 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:34 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-24c2c9cf-9c2b-413d-812e-9e7bc7db855d tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-2c539730-6280-4aae-9bad-5302d50087ce-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:34 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-24c2c9cf-9c2b-413d-812e-9e7bc7db855d tempest-ProjectMemberTests-219511464 None] Lock "cinder-2c539730-6280-4aae-9bad-5302d50087ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:34 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-24c2c9cf-9c2b-413d-812e-9e7bc7db855d tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-542cd372-ed58-45b8-9453-0076364ffe08" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:34 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-24c2c9cf-9c2b-413d-812e-9e7bc7db855d tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-542cd372-ed58-45b8-9453-0076364ffe08" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:34 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-24c2c9cf-9c2b-413d-812e-9e7bc7db855d tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-2c539730-6280-4aae-9bad-5302d50087ce" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:34 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-24c2c9cf-9c2b-413d-812e-9e7bc7db855d tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-2c539730-6280-4aae-9bad-5302d50087ce" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-24c2c9cf-9c2b-413d-812e-9e7bc7db855d tempest-ProjectMemberTests-219511464 None] Deleting offline snapshot 2c539730-6280-4aae-9bad-5302d50087ce of volume 542cd372-ed58-45b8-9453-0076364ffe08 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:23:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-24c2c9cf-9c2b-413d-812e-9e7bc7db855d tempest-ProjectMemberTests-219511464 None] snapshot_file for this snap is: volume-542cd372-ed58-45b8-9453-0076364ffe08.2c539730-6280-4aae-9bad-5302d50087ce {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:23:34 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc92258-77c4-418c-a53c-4ff43025c420]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-24c2c9cf-9c2b-413d-812e-9e7bc7db855d tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.2c539730-6280-4aae-9bad-5302d50087ce {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:34 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9b97fcaa-6d03-4352-af6f-02eac27e3ba7 tempest-VolumeDependencyTests-369377781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.391354b8-5732-4dc2-9785-aa4be9f8044d 1G" returned: 0 in 0.540s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9b97fcaa-6d03-4352-af6f-02eac27e3ba7 tempest-VolumeDependencyTests-369377781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55dc11ad-5e8f-4279-8d43-91ba88b23702 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.391354b8-5732-4dc2-9785-aa4be9f8044d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:34 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55dc11ad-5e8f-4279-8d43-91ba88b23702 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.391354b8-5732-4dc2-9785-aa4be9f8044d Sep 06 08:23:34 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:34 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.2c539730-6280-4aae-9bad-5302d50087ce Sep 06 08:23:34 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:34 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-24c2c9cf-9c2b-413d-812e-9e7bc7db855d tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.2c539730-6280-4aae-9bad-5302d50087ce" returned: 0 in 0.427s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:34 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-24c2c9cf-9c2b-413d-812e-9e7bc7db855d tempest-ProjectMemberTests-219511464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-542cd372-ed58-45b8-9453-0076364ffe08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:23:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9b97fcaa-6d03-4352-af6f-02eac27e3ba7 tempest-VolumeDependencyTests-369377781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55dc11ad-5e8f-4279-8d43-91ba88b23702 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.391354b8-5732-4dc2-9785-aa4be9f8044d" returned: 0 in 0.396s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:34 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-9b97fcaa-6d03-4352-af6f-02eac27e3ba7 tempest-VolumeDependencyTests-369377781 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.391354b8-5732-4dc2-9785-aa4be9f8044d is being set with open permissions: ugo+rw Sep 06 08:23:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9b97fcaa-6d03-4352-af6f-02eac27e3ba7 tempest-VolumeDependencyTests-369377781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.391354b8-5732-4dc2-9785-aa4be9f8044d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:34 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3000ff5-4a06-4096-8bd9-3ddf51d6af68]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-24c2c9cf-9c2b-413d-812e-9e7bc7db855d tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:34 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.391354b8-5732-4dc2-9785-aa4be9f8044d Sep 06 08:23:34 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:34 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08 Sep 06 08:23:34 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:34 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9b97fcaa-6d03-4352-af6f-02eac27e3ba7 tempest-VolumeDependencyTests-369377781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.391354b8-5732-4dc2-9785-aa4be9f8044d" returned: 0 in 0.350s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9b97fcaa-6d03-4352-af6f-02eac27e3ba7 tempest-VolumeDependencyTests-369377781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:23:35 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.info Sep 06 08:23:35 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Flow 'volume_create_manager' (85f9d630-757c-495e-9555-242395a9ccfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07b0d08-25b9-4160-b8a2-e7f52b8e9f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07b0d08-25b9-4160-b8a2-e7f52b8e9f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-328778023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9019c40-9cf9-48b0-949a-4afb70468647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943f88d91884479a99666bbea368fcfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:35Z,use_quota=True,user_id='70b3ef2d0d094d76b4c56590765ec0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb8aeb6-d058-4df7-b1f3-cb717acddc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb8aeb6-d058-4df7-b1f3-cb717acddc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99bd5dfa-0b52-4ea7-9a15-a69d743125e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99bd5dfa-0b52-4ea7-9a15-a69d743125e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9019c40-9cf9-48b0-949a-4afb70468647', 'volume_name': 'volume-e9019c40-9cf9-48b0-949a-4afb70468647', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9753b9cd-8eba-4fe3-ac04-2e90ca5d44d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9753b9cd-8eba-4fe3-ac04-2e90ca5d44d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:35 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5823f909-622e-41d7-938a-9432dbed9a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:35 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Volume e9019c40-9cf9-48b0-949a-4afb70468647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9019c40-9cf9-48b0-949a-4afb70468647', 'volume_size': 1} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-24c2c9cf-9c2b-413d-812e-9e7bc7db855d tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08" returned: 0 in 0.502s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-24c2c9cf-9c2b-413d-812e-9e7bc7db855d tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.2c539730-6280-4aae-9bad-5302d50087ce {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:35 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.2c539730-6280-4aae-9bad-5302d50087ce Sep 06 08:23:35 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:35 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9b97fcaa-6d03-4352-af6f-02eac27e3ba7 tempest-VolumeDependencyTests-369377781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.info" returned: 0 in 0.331s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:35 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-9b97fcaa-6d03-4352-af6f-02eac27e3ba7 tempest-VolumeDependencyTests-369377781 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.info is being set with open permissions: ugo+rw Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9b97fcaa-6d03-4352-af6f-02eac27e3ba7 tempest-VolumeDependencyTests-369377781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:35 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.info Sep 06 08:23:35 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:35 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-24c2c9cf-9c2b-413d-812e-9e7bc7db855d tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.2c539730-6280-4aae-9bad-5302d50087ce" returned: 0 in 0.366s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-24c2c9cf-9c2b-413d-812e-9e7bc7db855d tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.2c539730-6280-4aae-9bad-5302d50087ce {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:35 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.2c539730-6280-4aae-9bad-5302d50087ce Sep 06 08:23:35 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:35 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9b97fcaa-6d03-4352-af6f-02eac27e3ba7 tempest-VolumeDependencyTests-369377781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.info" returned: 0 in 0.264s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9b97fcaa-6d03-4352-af6f-02eac27e3ba7 tempest-VolumeDependencyTests-369377781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.434s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.512s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-328778023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9019c40-9cf9-48b0-949a-4afb70468647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943f88d91884479a99666bbea368fcfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:35Z,use_quota=True,user_id='70b3ef2d0d094d76b4c56590765ec0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Creating volume e9019c40-9cf9-48b0-949a-4afb70468647 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:23:35 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:35 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647 1073741824 Sep 06 08:23:35 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:35 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-9b97fcaa-6d03-4352-af6f-02eac27e3ba7 tempest-VolumeDependencyTests-369377781 None] Create snapshot completed successfully Sep 06 08:23:35 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-24c2c9cf-9c2b-413d-812e-9e7bc7db855d tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08.2c539730-6280-4aae-9bad-5302d50087ce" returned: 0 in 0.285s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-24c2c9cf-9c2b-413d-812e-9e7bc7db855d tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-2c539730-6280-4aae-9bad-5302d50087ce" released by "_delete_snapshot" :: held 1.714s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-24c2c9cf-9c2b-413d-812e-9e7bc7db855d tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-542cd372-ed58-45b8-9453-0076364ffe08" released by "delete_snapshot" :: held 1.751s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-24c2c9cf-9c2b-413d-812e-9e7bc7db855d tempest-ProjectMemberTests-219511464 None] Created reservations ['6b5521f0-7c49-4802-b003-9b7d15b49612', '6fe55a6e-bffa-4dce-a4a8-4f2a0d82d6e3', '335c22ec-a534-4ed0-b6cf-cc8907ac8333', 'cf196061-6b26-4f82-a9f8-0c58eeba079d'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:23:35 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-24c2c9cf-9c2b-413d-812e-9e7bc7db855d tempest-ProjectMemberTests-219511464 None] Delete snapshot completed successfully. Sep 06 08:23:35 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-24c2c9cf-9c2b-413d-812e-9e7bc7db855d tempest-ProjectMemberTests-219511464 None] Lock "cinder-2c539730-6280-4aae-9bad-5302d50087ce-delete_snapshot" released by "delete_snapshot" :: held 1.914s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:36 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647 1073741824" returned: 0 in 0.500s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:36 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647 Sep 06 08:23:36 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:36 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-17a1a6d3-0116-4e57-baa0-db6915415f98 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-542cd372-ed58-45b8-9453-0076364ffe08-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:36 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-17a1a6d3-0116-4e57-baa0-db6915415f98 tempest-ProjectMemberTests-219511464 None] Lock "cinder-542cd372-ed58-45b8-9453-0076364ffe08-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:36 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-17a1a6d3-0116-4e57-baa0-db6915415f98 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-542cd372-ed58-45b8-9453-0076364ffe08" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:36 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-17a1a6d3-0116-4e57-baa0-db6915415f98 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-542cd372-ed58-45b8-9453-0076364ffe08" acquired by "delete_volume" :: waited 0.014s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:36 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0340725-d1d2-4cc6-8452-91e55574ed0e]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-17a1a6d3-0116-4e57-baa0-db6915415f98 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:36 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647" returned: 0 in 0.307s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:36 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:23:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5823f909-622e-41d7-938a-9432dbed9a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9019c40-9cf9-48b0-949a-4afb70468647', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e26efa-fd21-4be3-b789-6e74a1e05d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:36 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Volume volume-e9019c40-9cf9-48b0-949a-4afb70468647 (e9019c40-9cf9-48b0-949a-4afb70468647): created successfully Sep 06 08:23:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e26efa-fd21-4be3-b789-6e74a1e05d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:36 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08 Sep 06 08:23:36 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Flow 'volume_create_manager' (85f9d630-757c-495e-9555-242395a9ccfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:36 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-38e89876-7c01-4f6c-bf01-76cc4cb8c360 tempest-CreateVolumesFromSnapshotTest-556812329 None] Created volume successfully. Sep 06 08:23:36 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-17a1a6d3-0116-4e57-baa0-db6915415f98 tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08" returned: 0 in 0.428s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-17a1a6d3-0116-4e57-baa0-db6915415f98 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:36 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08 Sep 06 08:23:36 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Flow 'volume_create_manager' (3a941d8b-3827-4674-a7cb-6f1c6d81b84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39080a9b-90b2-4de0-8aa7-be7d35f38e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39080a9b-90b2-4de0-8aa7-be7d35f38e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-896659175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f7195ba-6742-4298-9e07-9b789bbacc73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86c2f6a0832476db07e76d952d40352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=391354b8-5732-4dc2-9785-aa4be9f8044d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:37Z,use_quota=True,user_id='5c8017528ccf48b6b25fa5ef9cbd55d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d46119-0604-4d63-8ae4-86435030519e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:37 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d46119-0604-4d63-8ae4-86435030519e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e6b681c-3e52-4ad4-9580-e0d2cce99779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e6b681c-3e52-4ad4-9580-e0d2cce99779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0f7195ba-6742-4298-9e07-9b789bbacc73', 'volume_name': 'volume-0f7195ba-6742-4298-9e07-9b789bbacc73', 'volume_size': 1, 'snapshot_id': '391354b8-5732-4dc2-9785-aa4be9f8044d'}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae89c3f-60d1-4ded-98ae-cded2ab2f3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae89c3f-60d1-4ded-98ae-cded2ab2f3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd646d6-6402-4775-966c-1396783c6542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:37 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Volume 0f7195ba-6742-4298-9e07-9b789bbacc73: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0f7195ba-6742-4298-9e07-9b789bbacc73', 'volume_size': 1, 'snapshot_id': '391354b8-5732-4dc2-9785-aa4be9f8044d'} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-17a1a6d3-0116-4e57-baa0-db6915415f98 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-542cd372-ed58-45b8-9453-0076364ffe08" returned: 0 in 0.341s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Acquiring lock "cinder-quobyte-391354b8-5732-4dc2-9785-aa4be9f8044d-0f7195ba-6742-4298-9e07-9b789bbacc73" by "_create_volume_from_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-17a1a6d3-0116-4e57-baa0-db6915415f98 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-542cd372-ed58-45b8-9453-0076364ffe08" released by "delete_volume" :: held 0.857s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Lock "cinder-quobyte-391354b8-5732-4dc2-9785-aa4be9f8044d-0f7195ba-6742-4298-9e07-9b789bbacc73" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Creating volume 0f7195ba-6742-4298-9e07-9b789bbacc73 from snapshot 391354b8-5732-4dc2-9785-aa4be9f8044d {{(pid=87307) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Acquiring lock "cinder-quobyte-0f7195ba-6742-4298-9e07-9b789bbacc73" by "_copy_volume_from_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Lock "cinder-quobyte-0f7195ba-6742-4298-9e07-9b789bbacc73" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] snapshot: 391354b8-5732-4dc2-9785-aa4be9f8044d, volume: 0f7195ba-6742-4298-9e07-9b789bbacc73, {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[33461eb4-c6a8-4de6-8e0c-365c9c6c7d08]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.391354b8-5732-4dc2-9785-aa4be9f8044d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-17a1a6d3-0116-4e57-baa0-db6915415f98 tempest-ProjectMemberTests-219511464 None] Created reservations ['f33df315-2453-4d22-9917-92939e71feeb', 'e6009182-9995-47ce-86b0-ee129657e4ce', '154a718b-81d3-4cbd-822d-fc4e18559014', '6ac785c5-77c6-49ea-874a-30743ddeae9e'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8c4ef283-484f-4721-8e70-04b198ec70dd tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-17a1a6d3-0116-4e57-baa0-db6915415f98 tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-17a1a6d3-0116-4e57-baa0-db6915415f98 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-17a1a6d3-0116-4e57-baa0-db6915415f98 tempest-ProjectMemberTests-219511464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-17a1a6d3-0116-4e57-baa0-db6915415f98 tempest-ProjectMemberTests-219511464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-17a1a6d3-0116-4e57-baa0-db6915415f98 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-17a1a6d3-0116-4e57-baa0-db6915415f98 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:37 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:23:37 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:37 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.391354b8-5732-4dc2-9785-aa4be9f8044d Sep 06 08:23:37 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:37 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-17a1a6d3-0116-4e57-baa0-db6915415f98 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.262s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-17a1a6d3-0116-4e57-baa0-db6915415f98 tempest-ProjectMemberTests-219511464 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:23:37 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-17a1a6d3-0116-4e57-baa0-db6915415f98 tempest-ProjectMemberTests-219511464 None] Deleted volume successfully. Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-17a1a6d3-0116-4e57-baa0-db6915415f98 tempest-ProjectMemberTests-219511464 None] Lock "cinder-542cd372-ed58-45b8-9453-0076364ffe08-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:37 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.391354b8-5732-4dc2-9785-aa4be9f8044d" returned: 0 in 0.418s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55dc11ad-5e8f-4279-8d43-91ba88b23702(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f1f790-8cf7-48fd-9b8d-5ebe541215fb]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:37 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702 Sep 06 08:23:37 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:38 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702" returned: 0 in 0.384s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:38 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] will copy from snapshot at /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702 {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 06 08:23:38 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Creating direct copy from snapshot {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 06 08:23:38 devstack cinder-volume[87307]: DEBUG cinder.utils [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Path /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0f7195ba-6742-4298-9e07-9b789bbacc73 not found in is_blk_device check {{(pid=87307) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 06 08:23:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0f7195ba-6742-4298-9e07-9b789bbacc73 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:38 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0f7195ba-6742-4298-9e07-9b789bbacc73 Sep 06 08:23:38 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:39 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:23:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Flow 'volume_create_manager' (4459c496-4cbc-44d7-919a-61d6eeca1faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25abbaa-b60d-4303-a81d-3da554c42fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25abbaa-b60d-4303-a81d-3da554c42fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1498257359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ce01bd-8556-405e-b86e-d802c03239c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57ff192bd0a74a27be0be1f1201231cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:39Z,use_quota=True,user_id='0f50a8b862534662bb877ccafabde4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84e0ee8-64c4-4165-99d8-4d51ea50f764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84e0ee8-64c4-4165-99d8-4d51ea50f764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6c72ae-6ad2-4b19-bec1-f2f748ff6a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6c72ae-6ad2-4b19-bec1-f2f748ff6a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30ce01bd-8556-405e-b86e-d802c03239c9', 'volume_name': 'volume-30ce01bd-8556-405e-b86e-d802c03239c9', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa86432-7d39-455c-9f76-0d28e00fa12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa86432-7d39-455c-9f76-0d28e00fa12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76445d45-4100-4cab-b836-5994a60b41b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:39 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Volume 30ce01bd-8556-405e-b86e-d802c03239c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30ce01bd-8556-405e-b86e-d802c03239c9', 'volume_size': 1} Sep 06 08:23:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:43 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0f7195ba-6742-4298-9e07-9b789bbacc73" returned: 0 in 5.285s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:43 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Image conversion details: src /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702, size 1024.00 MB, duration 5.29 sec, destination /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0f7195ba-6742-4298-9e07-9b789bbacc73 {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:23:43 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Converted 1024.00 MB image at 193.72 MB/s Sep 06 08:23:43 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0f7195ba-6742-4298-9e07-9b789bbacc73 is being set with open permissions: ugo+rw Sep 06 08:23:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0f7195ba-6742-4298-9e07-9b789bbacc73 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:43 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0f7195ba-6742-4298-9e07-9b789bbacc73 Sep 06 08:23:43 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:43 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0f7195ba-6742-4298-9e07-9b789bbacc73" returned: 0 in 0.255s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Lock "cinder-quobyte-0f7195ba-6742-4298-9e07-9b789bbacc73" released by "_copy_volume_from_snapshot" :: held 6.477s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Lock "cinder-quobyte-391354b8-5732-4dc2-9785-aa4be9f8044d-0f7195ba-6742-4298-9e07-9b789bbacc73" released by "_create_volume_from_snapshot" :: held 6.564s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.591s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8c4ef283-484f-4721-8e70-04b198ec70dd tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.387s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:43 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-8c4ef283-484f-4721-8e70-04b198ec70dd tempest-CreateVolumesFromSnapshotTest-556812329 None] Creating offline snapshot c0cbd750-7aa2-4efc-bbb0-57d950a70fb7 of volume e9019c40-9cf9-48b0-949a-4afb70468647 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:23:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd646d6-6402-4775-966c-1396783c6542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f7195ba-6742-4298-9e07-9b789bbacc73', 'volume_size': 1, 'snapshot_id': '391354b8-5732-4dc2-9785-aa4be9f8044d'}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1682caef-87ab-4f3d-9455-58df72a50052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:43 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bed4d5-61a4-4629-97d9-5c8d2d4efa2b]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8c4ef283-484f-4721-8e70-04b198ec70dd tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:43 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Volume volume-0f7195ba-6742-4298-9e07-9b789bbacc73 (0f7195ba-6742-4298-9e07-9b789bbacc73): created successfully Sep 06 08:23:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1682caef-87ab-4f3d-9455-58df72a50052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:43 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Flow 'volume_create_manager' (3a941d8b-3827-4674-a7cb-6f1c6d81b84a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:43 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-45bf619c-fed1-4c7f-8001-1fba515af3e5 tempest-VolumeDependencyTests-369377781 None] Created volume successfully. Sep 06 08:23:43 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647 Sep 06 08:23:43 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:44 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8c4ef283-484f-4721-8e70-04b198ec70dd tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647" returned: 0 in 0.389s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8c4ef283-484f-4721-8e70-04b198ec70dd tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.c0cbd750-7aa2-4efc-bbb0-57d950a70fb7 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:44 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.c0cbd750-7aa2-4efc-bbb0-57d950a70fb7 1G Sep 06 08:23:44 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Flow 'volume_create_manager' (661ccfbb-5e1e-40f2-9a34-691c3bfcf581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b67db793-1af8-470d-bc06-b682e4bb91f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b67db793-1af8-470d-bc06-b682e4bb91f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-769397215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d57e7b34-0534-4d7d-868d-823c0a81fe6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb018e256c42410ba1a2450923229baf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:44Z,use_quota=True,user_id='d4ab15301f894c779e91ed5ab56df357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637ca4b0-c9be-42ac-bd56-9414d8a3f8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637ca4b0-c9be-42ac-bd56-9414d8a3f8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67006b44-783c-45a1-8b23-9ad7bab8ff0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67006b44-783c-45a1-8b23-9ad7bab8ff0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd57e7b34-0534-4d7d-868d-823c0a81fe6c', 'volume_name': 'volume-d57e7b34-0534-4d7d-868d-823c0a81fe6c', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20860e51-9c70-494b-b793-c2fec445fb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20860e51-9c70-494b-b793-c2fec445fb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e7214d-05b4-4f14-a1af-0ae0ce446a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:44 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Volume d57e7b34-0534-4d7d-868d-823c0a81fe6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d57e7b34-0534-4d7d-868d-823c0a81fe6c', 'volume_size': 1} Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:44 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8c4ef283-484f-4721-8e70-04b198ec70dd tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.c0cbd750-7aa2-4efc-bbb0-57d950a70fb7 1G" returned: 0 in 0.431s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8c4ef283-484f-4721-8e70-04b198ec70dd tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9019c40-9cf9-48b0-949a-4afb70468647 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.c0cbd750-7aa2-4efc-bbb0-57d950a70fb7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:44 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9019c40-9cf9-48b0-949a-4afb70468647 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.c0cbd750-7aa2-4efc-bbb0-57d950a70fb7 Sep 06 08:23:44 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-93218483-d510-4320-bbb2-253033ad7d36 tempest-VolumeDependencyTests-369377781 None] Acquiring lock "cinder-391354b8-5732-4dc2-9785-aa4be9f8044d-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-93218483-d510-4320-bbb2-253033ad7d36 tempest-VolumeDependencyTests-369377781 None] Lock "cinder-391354b8-5732-4dc2-9785-aa4be9f8044d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-93218483-d510-4320-bbb2-253033ad7d36 tempest-VolumeDependencyTests-369377781 None] Acquiring lock "cinder-quobyte-55dc11ad-5e8f-4279-8d43-91ba88b23702" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-93218483-d510-4320-bbb2-253033ad7d36 tempest-VolumeDependencyTests-369377781 None] Lock "cinder-quobyte-55dc11ad-5e8f-4279-8d43-91ba88b23702" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-93218483-d510-4320-bbb2-253033ad7d36 tempest-VolumeDependencyTests-369377781 None] Acquiring lock "cinder-quobyte-391354b8-5732-4dc2-9785-aa4be9f8044d" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-93218483-d510-4320-bbb2-253033ad7d36 tempest-VolumeDependencyTests-369377781 None] Lock "cinder-quobyte-391354b8-5732-4dc2-9785-aa4be9f8044d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-93218483-d510-4320-bbb2-253033ad7d36 tempest-VolumeDependencyTests-369377781 None] Deleting offline snapshot 391354b8-5732-4dc2-9785-aa4be9f8044d of volume 55dc11ad-5e8f-4279-8d43-91ba88b23702 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-93218483-d510-4320-bbb2-253033ad7d36 tempest-VolumeDependencyTests-369377781 None] snapshot_file for this snap is: volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.391354b8-5732-4dc2-9785-aa4be9f8044d {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7724e996-d2a2-4d37-95db-d5c22968aca8]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-93218483-d510-4320-bbb2-253033ad7d36 tempest-VolumeDependencyTests-369377781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.391354b8-5732-4dc2-9785-aa4be9f8044d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:44 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:44 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.391354b8-5732-4dc2-9785-aa4be9f8044d Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8c4ef283-484f-4721-8e70-04b198ec70dd tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9019c40-9cf9-48b0-949a-4afb70468647 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.c0cbd750-7aa2-4efc-bbb0-57d950a70fb7" returned: 0 in 0.312s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:44 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-8c4ef283-484f-4721-8e70-04b198ec70dd tempest-CreateVolumesFromSnapshotTest-556812329 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.c0cbd750-7aa2-4efc-bbb0-57d950a70fb7 is being set with open permissions: ugo+rw Sep 06 08:23:44 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8c4ef283-484f-4721-8e70-04b198ec70dd tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.c0cbd750-7aa2-4efc-bbb0-57d950a70fb7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:44 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.c0cbd750-7aa2-4efc-bbb0-57d950a70fb7 Sep 06 08:23:44 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:45 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8c4ef283-484f-4721-8e70-04b198ec70dd tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.c0cbd750-7aa2-4efc-bbb0-57d950a70fb7" returned: 0 in 0.240s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:45 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-93218483-d510-4320-bbb2-253033ad7d36 tempest-VolumeDependencyTests-369377781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.391354b8-5732-4dc2-9785-aa4be9f8044d" returned: 0 in 0.369s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-93218483-d510-4320-bbb2-253033ad7d36 tempest-VolumeDependencyTests-369377781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55dc11ad-5e8f-4279-8d43-91ba88b23702(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:23:45 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0070cef-c483-47ee-a301-43afe7c49034]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-93218483-d510-4320-bbb2-253033ad7d36 tempest-VolumeDependencyTests-369377781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8c4ef283-484f-4721-8e70-04b198ec70dd tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:45 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.info Sep 06 08:23:45 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:45 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702 Sep 06 08:23:45 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:45 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8c4ef283-484f-4721-8e70-04b198ec70dd tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.info" returned: 0 in 0.256s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:45 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-8c4ef283-484f-4721-8e70-04b198ec70dd tempest-CreateVolumesFromSnapshotTest-556812329 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.info is being set with open permissions: ugo+rw Sep 06 08:23:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8c4ef283-484f-4721-8e70-04b198ec70dd tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:45 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.info Sep 06 08:23:45 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:45 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:45 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8c4ef283-484f-4721-8e70-04b198ec70dd tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.info" returned: 0 in 0.248s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8c4ef283-484f-4721-8e70-04b198ec70dd tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.154s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1498257359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ce01bd-8556-405e-b86e-d802c03239c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57ff192bd0a74a27be0be1f1201231cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:39Z,use_quota=True,user_id='0f50a8b862534662bb877ccafabde4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:23:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Creating volume 30ce01bd-8556-405e-b86e-d802c03239c9 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:23:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:23:45 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:23:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-93218483-d510-4320-bbb2-253033ad7d36 tempest-VolumeDependencyTests-369377781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702" returned: 0 in 0.579s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-93218483-d510-4320-bbb2-253033ad7d36 tempest-VolumeDependencyTests-369377781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.391354b8-5732-4dc2-9785-aa4be9f8044d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:45 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9 1073741824 Sep 06 08:23:45 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:45 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.391354b8-5732-4dc2-9785-aa4be9f8044d Sep 06 08:23:45 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:45 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-8c4ef283-484f-4721-8e70-04b198ec70dd tempest-CreateVolumesFromSnapshotTest-556812329 None] Create snapshot completed successfully Sep 06 08:23:46 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-93218483-d510-4320-bbb2-253033ad7d36 tempest-VolumeDependencyTests-369377781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.391354b8-5732-4dc2-9785-aa4be9f8044d" returned: 0 in 0.358s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-93218483-d510-4320-bbb2-253033ad7d36 tempest-VolumeDependencyTests-369377781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.391354b8-5732-4dc2-9785-aa4be9f8044d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:46 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.391354b8-5732-4dc2-9785-aa4be9f8044d Sep 06 08:23:46 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:46 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9 1073741824" returned: 0 in 0.463s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:46 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9 Sep 06 08:23:46 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:46 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-93218483-d510-4320-bbb2-253033ad7d36 tempest-VolumeDependencyTests-369377781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702.391354b8-5732-4dc2-9785-aa4be9f8044d" returned: 0 in 0.262s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-93218483-d510-4320-bbb2-253033ad7d36 tempest-VolumeDependencyTests-369377781 None] Lock "cinder-quobyte-391354b8-5732-4dc2-9785-aa4be9f8044d" released by "_delete_snapshot" :: held 1.663s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-93218483-d510-4320-bbb2-253033ad7d36 tempest-VolumeDependencyTests-369377781 None] Lock "cinder-quobyte-55dc11ad-5e8f-4279-8d43-91ba88b23702" released by "delete_snapshot" :: held 1.688s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:46 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9" returned: 0 in 0.261s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.932s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-769397215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d57e7b34-0534-4d7d-868d-823c0a81fe6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb018e256c42410ba1a2450923229baf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:44Z,use_quota=True,user_id='d4ab15301f894c779e91ed5ab56df357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Creating volume d57e7b34-0534-4d7d-868d-823c0a81fe6c {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:23:46 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d57e7b34-0534-4d7d-868d-823c0a81fe6c 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-93218483-d510-4320-bbb2-253033ad7d36 tempest-VolumeDependencyTests-369377781 None] Created reservations ['e7127a59-1d34-48db-b863-00fe20774455', 'b54227f8-26e1-49f3-8d66-c1016fe77bbf', '730c192e-74b3-482f-8aca-0244671526b1', '4cb11974-a7fd-4bd1-82fa-eada023e8942'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76445d45-4100-4cab-b836-5994a60b41b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30ce01bd-8556-405e-b86e-d802c03239c9', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:46 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d57e7b34-0534-4d7d-868d-823c0a81fe6c 1073741824 Sep 06 08:23:46 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ecd42b-e994-46c2-a960-3229c732cdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:46 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Volume volume-30ce01bd-8556-405e-b86e-d802c03239c9 (30ce01bd-8556-405e-b86e-d802c03239c9): created successfully Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ecd42b-e994-46c2-a960-3229c732cdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Flow 'volume_create_manager' (4459c496-4cbc-44d7-919a-61d6eeca1faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:46 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-d5bdfdd6-54a5-4a0a-a26b-0859abaa2a0f tempest-ProjectMemberTests-219511464 None] Created volume successfully. Sep 06 08:23:46 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-93218483-d510-4320-bbb2-253033ad7d36 tempest-VolumeDependencyTests-369377781 None] Delete snapshot completed successfully. Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-93218483-d510-4320-bbb2-253033ad7d36 tempest-VolumeDependencyTests-369377781 None] Lock "cinder-391354b8-5732-4dc2-9785-aa4be9f8044d-delete_snapshot" released by "delete_snapshot" :: held 1.906s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:46 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-482c56ed-6314-4ea6-86a2-ed907d8709c8 tempest-VolumeDependencyTests-369377781 None] Acquiring lock "cinder-55dc11ad-5e8f-4279-8d43-91ba88b23702-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-482c56ed-6314-4ea6-86a2-ed907d8709c8 tempest-VolumeDependencyTests-369377781 None] Lock "cinder-55dc11ad-5e8f-4279-8d43-91ba88b23702-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-482c56ed-6314-4ea6-86a2-ed907d8709c8 tempest-VolumeDependencyTests-369377781 None] Acquiring lock "cinder-quobyte-55dc11ad-5e8f-4279-8d43-91ba88b23702" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-482c56ed-6314-4ea6-86a2-ed907d8709c8 tempest-VolumeDependencyTests-369377781 None] Lock "cinder-quobyte-55dc11ad-5e8f-4279-8d43-91ba88b23702" acquired by "delete_volume" :: waited 0.034s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0268658-adcd-4eb8-9a1e-95ed2c426e7c]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-482c56ed-6314-4ea6-86a2-ed907d8709c8 tempest-VolumeDependencyTests-369377781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:47 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d57e7b34-0534-4d7d-868d-823c0a81fe6c 1073741824" returned: 0 in 0.667s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3e7692bc-d365-4b0d-b3fa-34d00a5b1f04 tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d57e7b34-0534-4d7d-868d-823c0a81fe6c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:47 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d57e7b34-0534-4d7d-868d-823c0a81fe6c Sep 06 08:23:47 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:47 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702 Sep 06 08:23:47 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:47 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d57e7b34-0534-4d7d-868d-823c0a81fe6c" returned: 0 in 0.372s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3e7692bc-d365-4b0d-b3fa-34d00a5b1f04 tempest-ProjectMemberTests-219511464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.401s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:47 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e7214d-05b4-4f14-a1af-0ae0ce446a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d57e7b34-0534-4d7d-868d-823c0a81fe6c', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99e7494-f166-4e73-92df-ad4eb938b7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-3e7692bc-d365-4b0d-b3fa-34d00a5b1f04 tempest-ProjectMemberTests-219511464 None] Creating offline snapshot db9b1d3a-cf07-41a1-a845-3c5de2ec5858 of volume 30ce01bd-8556-405e-b86e-d802c03239c9 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-482c56ed-6314-4ea6-86a2-ed907d8709c8 tempest-VolumeDependencyTests-369377781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702" returned: 0 in 0.541s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-482c56ed-6314-4ea6-86a2-ed907d8709c8 tempest-VolumeDependencyTests-369377781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e32a5bb-f3cb-422f-a7e6-b0918be4c8c3]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3e7692bc-d365-4b0d-b3fa-34d00a5b1f04 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:47 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702 Sep 06 08:23:47 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Flow 'volume_create_manager' (556a20c9-fbea-4dc1-8719-66d09e41be48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5831375e-6875-4a1a-b767-b0a372acfe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:47 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Volume volume-d57e7b34-0534-4d7d-868d-823c0a81fe6c (d57e7b34-0534-4d7d-868d-823c0a81fe6c): created successfully Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99e7494-f166-4e73-92df-ad4eb938b7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Flow 'volume_create_manager' (661ccfbb-5e1e-40f2-9a34-691c3bfcf581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5831375e-6875-4a1a-b767-b0a372acfe97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-103873817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7fe3ede-e853-4b08-bcdb-ef848e80dc9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943f88d91884479a99666bbea368fcfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:48Z,use_quota=True,user_id='70b3ef2d0d094d76b4c56590765ec0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee791fdc-795f-4aea-b173-22ff1c9e52cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee791fdc-795f-4aea-b173-22ff1c9e52cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6324ea59-ba5f-41eb-be52-d7c45fcc6838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6324ea59-ba5f-41eb-be52-d7c45fcc6838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7fe3ede-e853-4b08-bcdb-ef848e80dc9f', 'volume_name': 'volume-d7fe3ede-e853-4b08-bcdb-ef848e80dc9f', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (399b5cde-4467-4092-90ae-99c4a49766e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (399b5cde-4467-4092-90ae-99c4a49766e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4467dba-a4e5-4947-8612-7203c585ceab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:47 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Volume d7fe3ede-e853-4b08-bcdb-ef848e80dc9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7fe3ede-e853-4b08-bcdb-ef848e80dc9f', 'volume_size': 1} Sep 06 08:23:47 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:47 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-253541fa-2d78-40a2-a44c-2212efb4348a tempest-ProjectReaderTests-1973586254 None] Created volume successfully. Sep 06 08:23:47 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9 Sep 06 08:23:47 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:48 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-482c56ed-6314-4ea6-86a2-ed907d8709c8 tempest-VolumeDependencyTests-369377781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-55dc11ad-5e8f-4279-8d43-91ba88b23702" returned: 0 in 0.288s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-482c56ed-6314-4ea6-86a2-ed907d8709c8 tempest-VolumeDependencyTests-369377781 None] Lock "cinder-quobyte-55dc11ad-5e8f-4279-8d43-91ba88b23702" released by "delete_volume" :: held 0.937s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Flow 'volume_create_manager' (dd7d9806-3cab-4562-986a-35c3a53402eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2e52fee-bac7-4c1a-977f-700e38ffb021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-482c56ed-6314-4ea6-86a2-ed907d8709c8 tempest-VolumeDependencyTests-369377781 None] Created reservations ['91a9d50d-cfc4-45e7-a56c-b3655dab5751', 'a7752f9e-8c14-4bb5-99ca-3991efefda45', 'fb4a7c2b-97dd-4813-b7bc-0ea31beae0ae', '78257d5e-efce-479c-ab1a-09fbd36ace64'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2e52fee-bac7-4c1a-977f-700e38ffb021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1456741033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3112eade-bb31-4629-b0cd-03dd24bb413b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943f88d91884479a99666bbea368fcfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:48Z,use_quota=True,user_id='70b3ef2d0d094d76b4c56590765ec0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c696ead5-e93c-4647-b020-1bf6599637a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c696ead5-e93c-4647-b020-1bf6599637a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175f75b1-063e-4887-863b-eaf851f5bff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175f75b1-063e-4887-863b-eaf851f5bff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3112eade-bb31-4629-b0cd-03dd24bb413b', 'volume_name': 'volume-3112eade-bb31-4629-b0cd-03dd24bb413b', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83670ef0-2b72-49fd-89a6-8e5b38c0f0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:48 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83670ef0-2b72-49fd-89a6-8e5b38c0f0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b128ce-39bb-45c6-b2e1-feb04688cafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:48 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Volume 3112eade-bb31-4629-b0cd-03dd24bb413b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3112eade-bb31-4629-b0cd-03dd24bb413b', 'volume_size': 1} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3e7692bc-d365-4b0d-b3fa-34d00a5b1f04 tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9" returned: 0 in 0.495s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3e7692bc-d365-4b0d-b3fa-34d00a5b1f04 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.db9b1d3a-cf07-41a1-a845-3c5de2ec5858 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:48 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.db9b1d3a-cf07-41a1-a845-3c5de2ec5858 1G Sep 06 08:23:48 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-482c56ed-6314-4ea6-86a2-ed907d8709c8 tempest-VolumeDependencyTests-369377781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-482c56ed-6314-4ea6-86a2-ed907d8709c8 tempest-VolumeDependencyTests-369377781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-482c56ed-6314-4ea6-86a2-ed907d8709c8 tempest-VolumeDependencyTests-369377781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-482c56ed-6314-4ea6-86a2-ed907d8709c8 tempest-VolumeDependencyTests-369377781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-482c56ed-6314-4ea6-86a2-ed907d8709c8 tempest-VolumeDependencyTests-369377781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-482c56ed-6314-4ea6-86a2-ed907d8709c8 tempest-VolumeDependencyTests-369377781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:48 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:23:48 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Flow 'volume_create_manager' (b611396f-7b31-449d-951c-a2eaed53f529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15e8e90-9ec5-49e6-a2ee-afe45740acf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15e8e90-9ec5-49e6-a2ee-afe45740acf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-908629924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549d13a5-1bbb-4dcd-af28-c2d17ca41fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943f88d91884479a99666bbea368fcfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:48Z,use_quota=True,user_id='70b3ef2d0d094d76b4c56590765ec0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d61e36f5-8517-473b-8be4-b819a012febd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d61e36f5-8517-473b-8be4-b819a012febd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d7959e-59fc-4112-923f-3b7ec2c8d0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d7959e-59fc-4112-923f-3b7ec2c8d0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '549d13a5-1bbb-4dcd-af28-c2d17ca41fd2', 'volume_name': 'volume-549d13a5-1bbb-4dcd-af28-c2d17ca41fd2', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9163b12c-af3d-4681-ab85-98d01f9608cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9163b12c-af3d-4681-ab85-98d01f9608cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd78336c-b559-4b77-a85e-0a4b454859f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:48 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Volume 549d13a5-1bbb-4dcd-af28-c2d17ca41fd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-549d13a5-1bbb-4dcd-af28-c2d17ca41fd2', 'volume_size': 1} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:48 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-482c56ed-6314-4ea6-86a2-ed907d8709c8 tempest-VolumeDependencyTests-369377781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.293s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-482c56ed-6314-4ea6-86a2-ed907d8709c8 tempest-VolumeDependencyTests-369377781 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:23:48 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-482c56ed-6314-4ea6-86a2-ed907d8709c8 tempest-VolumeDependencyTests-369377781 None] Deleted volume successfully. Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-482c56ed-6314-4ea6-86a2-ed907d8709c8 tempest-VolumeDependencyTests-369377781 None] Lock "cinder-55dc11ad-5e8f-4279-8d43-91ba88b23702-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:48 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3e7692bc-d365-4b0d-b3fa-34d00a5b1f04 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.db9b1d3a-cf07-41a1-a845-3c5de2ec5858 1G" returned: 0 in 0.655s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3e7692bc-d365-4b0d-b3fa-34d00a5b1f04 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30ce01bd-8556-405e-b86e-d802c03239c9 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.db9b1d3a-cf07-41a1-a845-3c5de2ec5858 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:48 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30ce01bd-8556-405e-b86e-d802c03239c9 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.db9b1d3a-cf07-41a1-a845-3c5de2ec5858 Sep 06 08:23:48 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Flow 'volume_create_manager' (8373f1b4-bb61-4fad-9006-e371351107c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389a82da-c56e-453a-9b70-ed62facb03b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:48 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-33aecb29-a100-4347-9580-945c6834704d tempest-ProjectReaderTests-1973586254 None] Acquiring lock "cinder-d57e7b34-0534-4d7d-868d-823c0a81fe6c-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389a82da-c56e-453a-9b70-ed62facb03b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1787371141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c8cf55-a991-4956-bd11-63cd20912425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943f88d91884479a99666bbea368fcfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:49Z,use_quota=True,user_id='70b3ef2d0d094d76b4c56590765ec0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f9b0ae-afa1-4e21-a64c-99a1ea5bb6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f9b0ae-afa1-4e21-a64c-99a1ea5bb6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce13c9c9-2533-41bc-8c3d-eb0eb0a3521f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce13c9c9-2533-41bc-8c3d-eb0eb0a3521f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1c8cf55-a991-4956-bd11-63cd20912425', 'volume_name': 'volume-b1c8cf55-a991-4956-bd11-63cd20912425', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad763b5-bed6-48a2-87c0-a070a3fc471c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad763b5-bed6-48a2-87c0-a070a3fc471c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1867c081-8466-448b-a440-c85ae81a9314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:49 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Volume b1c8cf55-a991-4956-bd11-63cd20912425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1c8cf55-a991-4956-bd11-63cd20912425', 'volume_size': 1} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-33aecb29-a100-4347-9580-945c6834704d tempest-ProjectReaderTests-1973586254 None] Lock "cinder-d57e7b34-0534-4d7d-868d-823c0a81fe6c-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-33aecb29-a100-4347-9580-945c6834704d tempest-ProjectReaderTests-1973586254 None] Acquiring lock "cinder-quobyte-d57e7b34-0534-4d7d-868d-823c0a81fe6c" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-33aecb29-a100-4347-9580-945c6834704d tempest-ProjectReaderTests-1973586254 None] Lock "cinder-quobyte-d57e7b34-0534-4d7d-868d-823c0a81fe6c" acquired by "delete_volume" :: waited 0.014s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b5e606-166f-4c52-a86d-34a0285569af]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-33aecb29-a100-4347-9580-945c6834704d tempest-ProjectReaderTests-1973586254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d57e7b34-0534-4d7d-868d-823c0a81fe6c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:49 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3e7692bc-d365-4b0d-b3fa-34d00a5b1f04 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30ce01bd-8556-405e-b86e-d802c03239c9 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.db9b1d3a-cf07-41a1-a845-3c5de2ec5858" returned: 0 in 0.378s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:49 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-3e7692bc-d365-4b0d-b3fa-34d00a5b1f04 tempest-ProjectMemberTests-219511464 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.db9b1d3a-cf07-41a1-a845-3c5de2ec5858 is being set with open permissions: ugo+rw Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3e7692bc-d365-4b0d-b3fa-34d00a5b1f04 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.db9b1d3a-cf07-41a1-a845-3c5de2ec5858 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:49 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d57e7b34-0534-4d7d-868d-823c0a81fe6c Sep 06 08:23:49 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:49 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.db9b1d3a-cf07-41a1-a845-3c5de2ec5858 Sep 06 08:23:49 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Flow 'volume_create_manager' (017b287c-36bf-4c01-a381-73f2342936c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3694096-f892-4995-bfcc-ff6c7e03a83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3694096-f892-4995-bfcc-ff6c7e03a83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-899128873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=104b39e7-afbe-48b7-a29d-7fff3c852712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943f88d91884479a99666bbea368fcfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:49Z,use_quota=True,user_id='70b3ef2d0d094d76b4c56590765ec0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04c26a1-0bde-41ad-b2ab-abe109b0a20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04c26a1-0bde-41ad-b2ab-abe109b0a20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def67c7d-e3b9-405f-afc2-940b7bf2934d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def67c7d-e3b9-405f-afc2-940b7bf2934d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '104b39e7-afbe-48b7-a29d-7fff3c852712', 'volume_name': 'volume-104b39e7-afbe-48b7-a29d-7fff3c852712', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93f2d28-bb85-4026-9736-3a56a2c9d09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93f2d28-bb85-4026-9736-3a56a2c9d09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4319b5b8-aaa7-48a0-ae95-77b47ae2537b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:49 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Volume 104b39e7-afbe-48b7-a29d-7fff3c852712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-104b39e7-afbe-48b7-a29d-7fff3c852712', 'volume_size': 1} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-59b7f124-ee7b-4b59-b552-aefd2970a1ae tempest-VolumeDependencyTests-369377781 None] Acquiring lock "cinder-0f7195ba-6742-4298-9e07-9b789bbacc73-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-59b7f124-ee7b-4b59-b552-aefd2970a1ae tempest-VolumeDependencyTests-369377781 None] Lock "cinder-0f7195ba-6742-4298-9e07-9b789bbacc73-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-59b7f124-ee7b-4b59-b552-aefd2970a1ae tempest-VolumeDependencyTests-369377781 None] Acquiring lock "cinder-quobyte-0f7195ba-6742-4298-9e07-9b789bbacc73" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-59b7f124-ee7b-4b59-b552-aefd2970a1ae tempest-VolumeDependencyTests-369377781 None] Lock "cinder-quobyte-0f7195ba-6742-4298-9e07-9b789bbacc73" acquired by "delete_volume" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9102b3-b4ce-4876-9608-e09a1e166c81]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-59b7f124-ee7b-4b59-b552-aefd2970a1ae tempest-VolumeDependencyTests-369377781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0f7195ba-6742-4298-9e07-9b789bbacc73 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:49 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-33aecb29-a100-4347-9580-945c6834704d tempest-ProjectReaderTests-1973586254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d57e7b34-0534-4d7d-868d-823c0a81fe6c" returned: 0 in 0.451s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-33aecb29-a100-4347-9580-945c6834704d tempest-ProjectReaderTests-1973586254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d57e7b34-0534-4d7d-868d-823c0a81fe6c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:49 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3e7692bc-d365-4b0d-b3fa-34d00a5b1f04 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.db9b1d3a-cf07-41a1-a845-3c5de2ec5858" returned: 0 in 0.332s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:49 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d57e7b34-0534-4d7d-868d-823c0a81fe6c Sep 06 08:23:49 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3e7692bc-d365-4b0d-b3fa-34d00a5b1f04 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:49 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0f7195ba-6742-4298-9e07-9b789bbacc73 Sep 06 08:23:49 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:49 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.info Sep 06 08:23:49 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:49 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-33aecb29-a100-4347-9580-945c6834704d tempest-ProjectReaderTests-1973586254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d57e7b34-0534-4d7d-868d-823c0a81fe6c" returned: 0 in 0.260s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-33aecb29-a100-4347-9580-945c6834704d tempest-ProjectReaderTests-1973586254 None] Lock "cinder-quobyte-d57e7b34-0534-4d7d-868d-823c0a81fe6c" released by "delete_volume" :: held 0.762s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:49 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3e7692bc-d365-4b0d-b3fa-34d00a5b1f04 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.info" returned: 0 in 0.279s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:49 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-3e7692bc-d365-4b0d-b3fa-34d00a5b1f04 tempest-ProjectMemberTests-219511464 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.info is being set with open permissions: ugo+rw Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3e7692bc-d365-4b0d-b3fa-34d00a5b1f04 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-33aecb29-a100-4347-9580-945c6834704d tempest-ProjectReaderTests-1973586254 None] Created reservations ['b968654b-8a9c-4674-bd2e-72152247a26f', '5a13b58b-aacf-4cd2-8df4-f207c45cebcb', '36e7643f-a9bd-4bbe-a7d4-bdb620313753', '492da518-f202-456f-a3ff-3621bb7a4564'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:23:49 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-59b7f124-ee7b-4b59-b552-aefd2970a1ae tempest-VolumeDependencyTests-369377781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0f7195ba-6742-4298-9e07-9b789bbacc73" returned: 0 in 0.401s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-59b7f124-ee7b-4b59-b552-aefd2970a1ae tempest-VolumeDependencyTests-369377781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0f7195ba-6742-4298-9e07-9b789bbacc73 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:49 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.info Sep 06 08:23:49 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:49 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0f7195ba-6742-4298-9e07-9b789bbacc73 Sep 06 08:23:49 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-33aecb29-a100-4347-9580-945c6834704d tempest-ProjectReaderTests-1973586254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-33aecb29-a100-4347-9580-945c6834704d tempest-ProjectReaderTests-1973586254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-33aecb29-a100-4347-9580-945c6834704d tempest-ProjectReaderTests-1973586254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-33aecb29-a100-4347-9580-945c6834704d tempest-ProjectReaderTests-1973586254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-33aecb29-a100-4347-9580-945c6834704d tempest-ProjectReaderTests-1973586254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-33aecb29-a100-4347-9580-945c6834704d tempest-ProjectReaderTests-1973586254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:50 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:23:50 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:50 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-59b7f124-ee7b-4b59-b552-aefd2970a1ae tempest-VolumeDependencyTests-369377781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0f7195ba-6742-4298-9e07-9b789bbacc73" returned: 0 in 0.326s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:50 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3e7692bc-d365-4b0d-b3fa-34d00a5b1f04 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.info" returned: 0 in 0.376s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3e7692bc-d365-4b0d-b3fa-34d00a5b1f04 tempest-ProjectMemberTests-219511464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.644s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-59b7f124-ee7b-4b59-b552-aefd2970a1ae tempest-VolumeDependencyTests-369377781 None] Lock "cinder-quobyte-0f7195ba-6742-4298-9e07-9b789bbacc73" released by "delete_volume" :: held 0.805s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.425s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-103873817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7fe3ede-e853-4b08-bcdb-ef848e80dc9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943f88d91884479a99666bbea368fcfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:48Z,use_quota=True,user_id='70b3ef2d0d094d76b4c56590765ec0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Creating volume d7fe3ede-e853-4b08-bcdb-ef848e80dc9f {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:50 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:23:50 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d7fe3ede-e853-4b08-bcdb-ef848e80dc9f 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-33aecb29-a100-4347-9580-945c6834704d tempest-ProjectReaderTests-1973586254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.336s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-33aecb29-a100-4347-9580-945c6834704d tempest-ProjectReaderTests-1973586254 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:23:50 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-33aecb29-a100-4347-9580-945c6834704d tempest-ProjectReaderTests-1973586254 None] Deleted volume successfully. Sep 06 08:23:50 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d7fe3ede-e853-4b08-bcdb-ef848e80dc9f 1073741824 Sep 06 08:23:50 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:50 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-3e7692bc-d365-4b0d-b3fa-34d00a5b1f04 tempest-ProjectMemberTests-219511464 None] Create snapshot completed successfully Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-33aecb29-a100-4347-9580-945c6834704d tempest-ProjectReaderTests-1973586254 None] Lock "cinder-d57e7b34-0534-4d7d-868d-823c0a81fe6c-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-59b7f124-ee7b-4b59-b552-aefd2970a1ae tempest-VolumeDependencyTests-369377781 None] Created reservations ['a00dbe4f-6474-4e83-925d-39970cda40ae', 'c7ed0209-0397-4ed5-b062-732e29baa22d', '53d1acdb-58a9-4f51-a404-38936044913e', 'da783ad3-1f84-41de-b170-19088cbea609'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-59b7f124-ee7b-4b59-b552-aefd2970a1ae tempest-VolumeDependencyTests-369377781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-59b7f124-ee7b-4b59-b552-aefd2970a1ae tempest-VolumeDependencyTests-369377781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-59b7f124-ee7b-4b59-b552-aefd2970a1ae tempest-VolumeDependencyTests-369377781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-59b7f124-ee7b-4b59-b552-aefd2970a1ae tempest-VolumeDependencyTests-369377781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-59b7f124-ee7b-4b59-b552-aefd2970a1ae tempest-VolumeDependencyTests-369377781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-59b7f124-ee7b-4b59-b552-aefd2970a1ae tempest-VolumeDependencyTests-369377781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:50 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:23:50 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Flow 'volume_create_manager' (eb4892d1-763b-44a1-bba9-6d29dc35fd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a55b39e7-01ed-43d9-b83a-84e82075c0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a55b39e7-01ed-43d9-b83a-84e82075c0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-752835320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0323ce55-0533-4d5a-89d8-4564e69806f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb018e256c42410ba1a2450923229baf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:51Z,use_quota=True,user_id='d4ab15301f894c779e91ed5ab56df357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30aad12b-8acb-475c-b395-ded26451f956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30aad12b-8acb-475c-b395-ded26451f956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98169631-64fa-4936-93f7-bd7367d95b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98169631-64fa-4936-93f7-bd7367d95b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0323ce55-0533-4d5a-89d8-4564e69806f4', 'volume_name': 'volume-0323ce55-0533-4d5a-89d8-4564e69806f4', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:50 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0421d320-9641-4699-846e-55bcf5cfa136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0421d320-9641-4699-846e-55bcf5cfa136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b94ab20-f7ce-4ba5-a67d-e9ce32d5b11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:50 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Volume 0323ce55-0533-4d5a-89d8-4564e69806f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0323ce55-0533-4d5a-89d8-4564e69806f4', 'volume_size': 1} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d7fe3ede-e853-4b08-bcdb-ef848e80dc9f 1073741824" returned: 0 in 0.547s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:50 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-59b7f124-ee7b-4b59-b552-aefd2970a1ae tempest-VolumeDependencyTests-369377781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.331s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-59b7f124-ee7b-4b59-b552-aefd2970a1ae tempest-VolumeDependencyTests-369377781 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:23:50 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-59b7f124-ee7b-4b59-b552-aefd2970a1ae tempest-VolumeDependencyTests-369377781 None] Deleted volume successfully. Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d7fe3ede-e853-4b08-bcdb-ef848e80dc9f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:50 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-59b7f124-ee7b-4b59-b552-aefd2970a1ae tempest-VolumeDependencyTests-369377781 None] Lock "cinder-0f7195ba-6742-4298-9e07-9b789bbacc73-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:50 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d7fe3ede-e853-4b08-bcdb-ef848e80dc9f Sep 06 08:23:50 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:51 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d7fe3ede-e853-4b08-bcdb-ef848e80dc9f" returned: 0 in 0.269s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.976s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1456741033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3112eade-bb31-4629-b0cd-03dd24bb413b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943f88d91884479a99666bbea368fcfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:48Z,use_quota=True,user_id='70b3ef2d0d094d76b4c56590765ec0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Creating volume 3112eade-bb31-4629-b0cd-03dd24bb413b {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:23:51 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3112eade-bb31-4629-b0cd-03dd24bb413b 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4467dba-a4e5-4947-8612-7203c585ceab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7fe3ede-e853-4b08-bcdb-ef848e80dc9f', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:51 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3112eade-bb31-4629-b0cd-03dd24bb413b 1073741824 Sep 06 08:23:51 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848218e8-16f7-4728-8bb4-fdca9c7580ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:51 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Volume volume-d7fe3ede-e853-4b08-bcdb-ef848e80dc9f (d7fe3ede-e853-4b08-bcdb-ef848e80dc9f): created successfully Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848218e8-16f7-4728-8bb4-fdca9c7580ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Flow 'volume_create_manager' (556a20c9-fbea-4dc1-8719-66d09e41be48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:51 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-d35d6d02-18d1-459a-9f35-b8513268d6d8 tempest-CreateVolumesFromSnapshotTest-556812329 None] Created volume successfully. Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b5672469-fba9-4394-ba6c-85495f1804b3 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-db9b1d3a-cf07-41a1-a845-3c5de2ec5858-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b5672469-fba9-4394-ba6c-85495f1804b3 tempest-ProjectMemberTests-219511464 None] Lock "cinder-db9b1d3a-cf07-41a1-a845-3c5de2ec5858-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b5672469-fba9-4394-ba6c-85495f1804b3 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-30ce01bd-8556-405e-b86e-d802c03239c9" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b5672469-fba9-4394-ba6c-85495f1804b3 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-30ce01bd-8556-405e-b86e-d802c03239c9" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b5672469-fba9-4394-ba6c-85495f1804b3 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-db9b1d3a-cf07-41a1-a845-3c5de2ec5858" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b5672469-fba9-4394-ba6c-85495f1804b3 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-db9b1d3a-cf07-41a1-a845-3c5de2ec5858" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-b5672469-fba9-4394-ba6c-85495f1804b3 tempest-ProjectMemberTests-219511464 None] Deleting offline snapshot db9b1d3a-cf07-41a1-a845-3c5de2ec5858 of volume 30ce01bd-8556-405e-b86e-d802c03239c9 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-b5672469-fba9-4394-ba6c-85495f1804b3 tempest-ProjectMemberTests-219511464 None] snapshot_file for this snap is: volume-30ce01bd-8556-405e-b86e-d802c03239c9.db9b1d3a-cf07-41a1-a845-3c5de2ec5858 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2703a9d4-1bae-4423-a281-10fc221b8f79]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b5672469-fba9-4394-ba6c-85495f1804b3 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.db9b1d3a-cf07-41a1-a845-3c5de2ec5858 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:51 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3112eade-bb31-4629-b0cd-03dd24bb413b 1073741824" returned: 0 in 0.534s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:51 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.db9b1d3a-cf07-41a1-a845-3c5de2ec5858 Sep 06 08:23:51 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3112eade-bb31-4629-b0cd-03dd24bb413b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:51 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3112eade-bb31-4629-b0cd-03dd24bb413b Sep 06 08:23:51 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:52 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b5672469-fba9-4394-ba6c-85495f1804b3 tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.db9b1d3a-cf07-41a1-a845-3c5de2ec5858" returned: 0 in 0.437s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-b5672469-fba9-4394-ba6c-85495f1804b3 tempest-ProjectMemberTests-219511464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30ce01bd-8556-405e-b86e-d802c03239c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:23:52 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3112eade-bb31-4629-b0cd-03dd24bb413b" returned: 0 in 0.294s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.484s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-908629924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549d13a5-1bbb-4dcd-af28-c2d17ca41fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943f88d91884479a99666bbea368fcfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:48Z,use_quota=True,user_id='70b3ef2d0d094d76b4c56590765ec0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Creating volume 549d13a5-1bbb-4dcd-af28-c2d17ca41fd2 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:23:52 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-549d13a5-1bbb-4dcd-af28-c2d17ca41fd2 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71edff0-676b-4b4e-b4da-24a05c13452a]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b5672469-fba9-4394-ba6c-85495f1804b3 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:52 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-549d13a5-1bbb-4dcd-af28-c2d17ca41fd2 1073741824 Sep 06 08:23:52 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b128ce-39bb-45c6-b2e1-feb04688cafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3112eade-bb31-4629-b0cd-03dd24bb413b', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cedad03-80fe-4adb-98ef-53980bad76bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:52 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Volume volume-3112eade-bb31-4629-b0cd-03dd24bb413b (3112eade-bb31-4629-b0cd-03dd24bb413b): created successfully Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cedad03-80fe-4adb-98ef-53980bad76bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Flow 'volume_create_manager' (dd7d9806-3cab-4562-986a-35c3a53402eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:52 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-1f6f1ebe-df0c-43fa-b74c-aa4d2f312dba tempest-CreateVolumesFromSnapshotTest-556812329 None] Created volume successfully. Sep 06 08:23:52 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9 Sep 06 08:23:52 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:52 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b5672469-fba9-4394-ba6c-85495f1804b3 tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9" returned: 0 in 0.468s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b5672469-fba9-4394-ba6c-85495f1804b3 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.db9b1d3a-cf07-41a1-a845-3c5de2ec5858 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:52 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.db9b1d3a-cf07-41a1-a845-3c5de2ec5858 Sep 06 08:23:52 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:52 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-549d13a5-1bbb-4dcd-af28-c2d17ca41fd2 1073741824" returned: 0 in 0.544s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-549d13a5-1bbb-4dcd-af28-c2d17ca41fd2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:52 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-549d13a5-1bbb-4dcd-af28-c2d17ca41fd2 Sep 06 08:23:52 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:53 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-549d13a5-1bbb-4dcd-af28-c2d17ca41fd2" returned: 0 in 0.327s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.977s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1787371141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c8cf55-a991-4956-bd11-63cd20912425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943f88d91884479a99666bbea368fcfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:49Z,use_quota=True,user_id='70b3ef2d0d094d76b4c56590765ec0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Creating volume b1c8cf55-a991-4956-bd11-63cd20912425 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:53 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:23:53 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1c8cf55-a991-4956-bd11-63cd20912425 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b5672469-fba9-4394-ba6c-85495f1804b3 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.db9b1d3a-cf07-41a1-a845-3c5de2ec5858" returned: 0 in 0.471s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b5672469-fba9-4394-ba6c-85495f1804b3 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.db9b1d3a-cf07-41a1-a845-3c5de2ec5858 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:53 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1c8cf55-a991-4956-bd11-63cd20912425 1073741824 Sep 06 08:23:53 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd78336c-b559-4b77-a85e-0a4b454859f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-549d13a5-1bbb-4dcd-af28-c2d17ca41fd2', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:53 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.db9b1d3a-cf07-41a1-a845-3c5de2ec5858 Sep 06 08:23:53 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b13711-d98c-4529-ad36-d311f163c5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:53 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Volume volume-549d13a5-1bbb-4dcd-af28-c2d17ca41fd2 (549d13a5-1bbb-4dcd-af28-c2d17ca41fd2): created successfully Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b13711-d98c-4529-ad36-d311f163c5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Flow 'volume_create_manager' (b611396f-7b31-449d-951c-a2eaed53f529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:53 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-8c65ebe0-fd37-4102-826d-e7bbc7380c0e tempest-CreateVolumesFromSnapshotTest-556812329 None] Created volume successfully. Sep 06 08:23:53 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b5672469-fba9-4394-ba6c-85495f1804b3 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9.db9b1d3a-cf07-41a1-a845-3c5de2ec5858" returned: 0 in 0.304s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b5672469-fba9-4394-ba6c-85495f1804b3 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-db9b1d3a-cf07-41a1-a845-3c5de2ec5858" released by "_delete_snapshot" :: held 1.800s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b5672469-fba9-4394-ba6c-85495f1804b3 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-30ce01bd-8556-405e-b86e-d802c03239c9" released by "delete_snapshot" :: held 1.830s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-b5672469-fba9-4394-ba6c-85495f1804b3 tempest-ProjectMemberTests-219511464 None] Created reservations ['336d52c0-0571-46f7-be63-83ddd3263675', 'cc615b34-69e9-46bc-bec8-8713ee06a504', '25cf3ace-dd1d-45b1-afed-ff34f3a97007', '373116a3-040e-48f8-b3bd-c4e2161ece86'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:23:53 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-b5672469-fba9-4394-ba6c-85495f1804b3 tempest-ProjectMemberTests-219511464 None] Delete snapshot completed successfully. Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b5672469-fba9-4394-ba6c-85495f1804b3 tempest-ProjectMemberTests-219511464 None] Lock "cinder-db9b1d3a-cf07-41a1-a845-3c5de2ec5858-delete_snapshot" released by "delete_snapshot" :: held 1.983s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:53 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1c8cf55-a991-4956-bd11-63cd20912425 1073741824" returned: 0 in 0.533s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1c8cf55-a991-4956-bd11-63cd20912425 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:53 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1c8cf55-a991-4956-bd11-63cd20912425 Sep 06 08:23:53 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c7daa136-aa9a-4fea-86d5-8876117770d6 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-30ce01bd-8556-405e-b86e-d802c03239c9-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c7daa136-aa9a-4fea-86d5-8876117770d6 tempest-ProjectMemberTests-219511464 None] Lock "cinder-30ce01bd-8556-405e-b86e-d802c03239c9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c7daa136-aa9a-4fea-86d5-8876117770d6 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-30ce01bd-8556-405e-b86e-d802c03239c9" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c7daa136-aa9a-4fea-86d5-8876117770d6 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-30ce01bd-8556-405e-b86e-d802c03239c9" acquired by "delete_volume" :: waited 0.019s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6cab2f-a229-46a8-bf58-0437e95e9d8e]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c7daa136-aa9a-4fea-86d5-8876117770d6 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:53 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1c8cf55-a991-4956-bd11-63cd20912425" returned: 0 in 0.289s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.481s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-899128873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=104b39e7-afbe-48b7-a29d-7fff3c852712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943f88d91884479a99666bbea368fcfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:49Z,use_quota=True,user_id='70b3ef2d0d094d76b4c56590765ec0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Creating volume 104b39e7-afbe-48b7-a29d-7fff3c852712 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:23:53 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-104b39e7-afbe-48b7-a29d-7fff3c852712 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1867c081-8466-448b-a440-c85ae81a9314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1c8cf55-a991-4956-bd11-63cd20912425', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e38a57d-7c7b-4e31-9673-796700f75e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:53 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9 Sep 06 08:23:53 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:53 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-104b39e7-afbe-48b7-a29d-7fff3c852712 1073741824 Sep 06 08:23:53 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:53 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Volume volume-b1c8cf55-a991-4956-bd11-63cd20912425 (b1c8cf55-a991-4956-bd11-63cd20912425): created successfully Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e38a57d-7c7b-4e31-9673-796700f75e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:53 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Flow 'volume_create_manager' (8373f1b4-bb61-4fad-9006-e371351107c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:54 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-dbb44c32-027d-40be-8ecc-189cd52a032f tempest-CreateVolumesFromSnapshotTest-556812329 None] Created volume successfully. Sep 06 08:23:54 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c7daa136-aa9a-4fea-86d5-8876117770d6 tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9" returned: 0 in 0.421s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c7daa136-aa9a-4fea-86d5-8876117770d6 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:54 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9 Sep 06 08:23:54 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:54 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-104b39e7-afbe-48b7-a29d-7fff3c852712 1073741824" returned: 0 in 0.509s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-104b39e7-afbe-48b7-a29d-7fff3c852712 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:54 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-104b39e7-afbe-48b7-a29d-7fff3c852712 Sep 06 08:23:54 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:54 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c7daa136-aa9a-4fea-86d5-8876117770d6 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-30ce01bd-8556-405e-b86e-d802c03239c9" returned: 0 in 0.267s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c7daa136-aa9a-4fea-86d5-8876117770d6 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-30ce01bd-8556-405e-b86e-d802c03239c9" released by "delete_volume" :: held 0.754s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-c7daa136-aa9a-4fea-86d5-8876117770d6 tempest-ProjectMemberTests-219511464 None] Created reservations ['21c512ee-502a-4593-8087-33cc7db86369', 'ab3446bd-fbcb-4e81-8acb-f000f5e64a15', '86f4b010-1088-4f9d-b575-60e2f2da0a70', 'd7120673-e6c6-46f6-8a12-45ed10675caf'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c7daa136-aa9a-4fea-86d5-8876117770d6 tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c7daa136-aa9a-4fea-86d5-8876117770d6 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c7daa136-aa9a-4fea-86d5-8876117770d6 tempest-ProjectMemberTests-219511464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-c7daa136-aa9a-4fea-86d5-8876117770d6 tempest-ProjectMemberTests-219511464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-c7daa136-aa9a-4fea-86d5-8876117770d6 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c7daa136-aa9a-4fea-86d5-8876117770d6 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:54 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:23:54 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:54 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-104b39e7-afbe-48b7-a29d-7fff3c852712" returned: 0 in 0.296s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.883s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-752835320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0323ce55-0533-4d5a-89d8-4564e69806f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb018e256c42410ba1a2450923229baf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:51Z,use_quota=True,user_id='d4ab15301f894c779e91ed5ab56df357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Creating volume 0323ce55-0533-4d5a-89d8-4564e69806f4 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:23:54 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0323ce55-0533-4d5a-89d8-4564e69806f4 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:54 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0323ce55-0533-4d5a-89d8-4564e69806f4 1073741824 Sep 06 08:23:54 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4319b5b8-aaa7-48a0-ae95-77b47ae2537b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-104b39e7-afbe-48b7-a29d-7fff3c852712', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c75ec8-6963-4a86-a2f9-705eca249f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:54 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Volume volume-104b39e7-afbe-48b7-a29d-7fff3c852712 (104b39e7-afbe-48b7-a29d-7fff3c852712): created successfully Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c75ec8-6963-4a86-a2f9-705eca249f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:54 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Flow 'volume_create_manager' (017b287c-36bf-4c01-a381-73f2342936c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:54 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-ad0076a4-1347-4938-abcf-6ca6fc14b35a tempest-CreateVolumesFromSnapshotTest-556812329 None] Created volume successfully. Sep 06 08:23:55 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-c7daa136-aa9a-4fea-86d5-8876117770d6 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.378s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-c7daa136-aa9a-4fea-86d5-8876117770d6 tempest-ProjectMemberTests-219511464 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:23:55 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-c7daa136-aa9a-4fea-86d5-8876117770d6 tempest-ProjectMemberTests-219511464 None] Deleted volume successfully. Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-c7daa136-aa9a-4fea-86d5-8876117770d6 tempest-ProjectMemberTests-219511464 None] Lock "cinder-30ce01bd-8556-405e-b86e-d802c03239c9-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:55 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0323ce55-0533-4d5a-89d8-4564e69806f4 1073741824" returned: 0 in 0.592s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0323ce55-0533-4d5a-89d8-4564e69806f4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:55 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0323ce55-0533-4d5a-89d8-4564e69806f4 Sep 06 08:23:55 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Flow 'volume_create_manager' (391ff529-9e7d-4b8c-86cd-12c709608c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8bd47cf-14da-467e-ab26-c0d2a5c9768e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8bd47cf-14da-467e-ab26-c0d2a5c9768e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1882334685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce048414-09e4-42fe-9907-74770924e56b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57ff192bd0a74a27be0be1f1201231cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:56Z,use_quota=True,user_id='0f50a8b862534662bb877ccafabde4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eff1e3f-9152-414d-bead-b351dd6f13e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eff1e3f-9152-414d-bead-b351dd6f13e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f553bd31-850a-4620-97df-c1fe886e0b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f553bd31-850a-4620-97df-c1fe886e0b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce048414-09e4-42fe-9907-74770924e56b', 'volume_name': 'volume-ce048414-09e4-42fe-9907-74770924e56b', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b1a781-3b44-4b44-9e74-96eccd4b0f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b1a781-3b44-4b44-9e74-96eccd4b0f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e41d13-34bc-4ba2-a58a-b95ab0ffd389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:55 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Volume ce048414-09e4-42fe-9907-74770924e56b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce048414-09e4-42fe-9907-74770924e56b', 'volume_size': 1} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:55 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0323ce55-0533-4d5a-89d8-4564e69806f4" returned: 0 in 0.264s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.048s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1882334685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce048414-09e4-42fe-9907-74770924e56b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57ff192bd0a74a27be0be1f1201231cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:56Z,use_quota=True,user_id='0f50a8b862534662bb877ccafabde4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Creating volume ce048414-09e4-42fe-9907-74770924e56b {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:23:55 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b94ab20-f7ce-4ba5-a67d-e9ce32d5b11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0323ce55-0533-4d5a-89d8-4564e69806f4', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:55 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b 1073741824 Sep 06 08:23:55 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1cdfb91-3aec-4d59-913a-899448ae7f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:55 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Volume volume-0323ce55-0533-4d5a-89d8-4564e69806f4 (0323ce55-0533-4d5a-89d8-4564e69806f4): created successfully Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1cdfb91-3aec-4d59-913a-899448ae7f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Flow 'volume_create_manager' (eb4892d1-763b-44a1-bba9-6d29dc35fd66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:55 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f7770a4d-3895-4058-a849-d494a4138963 tempest-ProjectReaderTests-1973586254 None] Created volume successfully. Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3c89b1e9-e3ed-4223-8d58-619d73865b88 tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "cinder-104b39e7-afbe-48b7-a29d-7fff3c852712-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3c89b1e9-e3ed-4223-8d58-619d73865b88 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-104b39e7-afbe-48b7-a29d-7fff3c852712-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3c89b1e9-e3ed-4223-8d58-619d73865b88 tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "cinder-quobyte-104b39e7-afbe-48b7-a29d-7fff3c852712" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3c89b1e9-e3ed-4223-8d58-619d73865b88 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-quobyte-104b39e7-afbe-48b7-a29d-7fff3c852712" acquired by "delete_volume" :: waited 0.028s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[840a006e-c2b4-40b9-8edd-243c366693a5]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3c89b1e9-e3ed-4223-8d58-619d73865b88 tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-104b39e7-afbe-48b7-a29d-7fff3c852712 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:56 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b 1073741824" returned: 0 in 0.588s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-cd2ba132-7c90-4027-a83c-9c61a48441b2 tempest-ProjectReaderTests-1973586254 None] Acquiring lock "cinder-0323ce55-0533-4d5a-89d8-4564e69806f4-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-cd2ba132-7c90-4027-a83c-9c61a48441b2 tempest-ProjectReaderTests-1973586254 None] Lock "cinder-0323ce55-0533-4d5a-89d8-4564e69806f4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:56 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-104b39e7-afbe-48b7-a29d-7fff3c852712 Sep 06 08:23:56 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-cd2ba132-7c90-4027-a83c-9c61a48441b2 tempest-ProjectReaderTests-1973586254 None] Acquiring lock "cinder-quobyte-0323ce55-0533-4d5a-89d8-4564e69806f4" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:56 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b Sep 06 08:23:56 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-cd2ba132-7c90-4027-a83c-9c61a48441b2 tempest-ProjectReaderTests-1973586254 None] Lock "cinder-quobyte-0323ce55-0533-4d5a-89d8-4564e69806f4" acquired by "delete_volume" :: waited 0.032s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[319026fa-f074-42f6-a1e8-355b2498b196]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cd2ba132-7c90-4027-a83c-9c61a48441b2 tempest-ProjectReaderTests-1973586254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0323ce55-0533-4d5a-89d8-4564e69806f4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:56 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0323ce55-0533-4d5a-89d8-4564e69806f4 Sep 06 08:23:56 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:56 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3c89b1e9-e3ed-4223-8d58-619d73865b88 tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-104b39e7-afbe-48b7-a29d-7fff3c852712" returned: 0 in 0.456s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3c89b1e9-e3ed-4223-8d58-619d73865b88 tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-104b39e7-afbe-48b7-a29d-7fff3c852712 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:56 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-104b39e7-afbe-48b7-a29d-7fff3c852712 Sep 06 08:23:56 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:56 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b" returned: 0 in 0.367s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e41d13-34bc-4ba2-a58a-b95ab0ffd389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce048414-09e4-42fe-9907-74770924e56b', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b5823b-1fb6-4954-9245-65289330e7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:56 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Volume volume-ce048414-09e4-42fe-9907-74770924e56b (ce048414-09e4-42fe-9907-74770924e56b): created successfully Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b5823b-1fb6-4954-9245-65289330e7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Flow 'volume_create_manager' (391ff529-9e7d-4b8c-86cd-12c709608c6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:56 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-9dacd71a-05fa-415c-9715-ff06993393c7 tempest-ProjectMemberTests-219511464 None] Created volume successfully. Sep 06 08:23:56 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cd2ba132-7c90-4027-a83c-9c61a48441b2 tempest-ProjectReaderTests-1973586254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0323ce55-0533-4d5a-89d8-4564e69806f4" returned: 0 in 0.414s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cd2ba132-7c90-4027-a83c-9c61a48441b2 tempest-ProjectReaderTests-1973586254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0323ce55-0533-4d5a-89d8-4564e69806f4 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:56 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0323ce55-0533-4d5a-89d8-4564e69806f4 Sep 06 08:23:56 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:56 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3c89b1e9-e3ed-4223-8d58-619d73865b88 tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-104b39e7-afbe-48b7-a29d-7fff3c852712" returned: 0 in 0.268s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:56 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3c89b1e9-e3ed-4223-8d58-619d73865b88 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-quobyte-104b39e7-afbe-48b7-a29d-7fff3c852712" released by "delete_volume" :: held 0.790s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-3c89b1e9-e3ed-4223-8d58-619d73865b88 tempest-CreateVolumesFromSnapshotTest-556812329 None] Created reservations ['818e07b9-435e-44b4-938a-1dbbc8e1eec2', '39d41c2a-fe6f-4bfe-8ee5-a86c94e25a4e', '8def8313-649c-4836-a094-8779c9d8e6c8', '79f3edb8-b49d-4848-a59b-cce7e584a918'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3c89b1e9-e3ed-4223-8d58-619d73865b88 tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3c89b1e9-e3ed-4223-8d58-619d73865b88 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3c89b1e9-e3ed-4223-8d58-619d73865b88 tempest-CreateVolumesFromSnapshotTest-556812329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3c89b1e9-e3ed-4223-8d58-619d73865b88 tempest-CreateVolumesFromSnapshotTest-556812329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3c89b1e9-e3ed-4223-8d58-619d73865b88 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3c89b1e9-e3ed-4223-8d58-619d73865b88 tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:57 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:23:57 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:57 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cd2ba132-7c90-4027-a83c-9c61a48441b2 tempest-ProjectReaderTests-1973586254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-0323ce55-0533-4d5a-89d8-4564e69806f4" returned: 0 in 0.301s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-cd2ba132-7c90-4027-a83c-9c61a48441b2 tempest-ProjectReaderTests-1973586254 None] Lock "cinder-quobyte-0323ce55-0533-4d5a-89d8-4564e69806f4" released by "delete_volume" :: held 0.814s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-65ebf718-1de4-47ab-8415-ee94bddaf23c tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "cinder-b1c8cf55-a991-4956-bd11-63cd20912425-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-65ebf718-1de4-47ab-8415-ee94bddaf23c tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-b1c8cf55-a991-4956-bd11-63cd20912425-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-cd2ba132-7c90-4027-a83c-9c61a48441b2 tempest-ProjectReaderTests-1973586254 None] Created reservations ['78be53b7-5094-4667-ae01-bd747104cd2c', 'ce203765-a0ff-4410-a007-673e7ec45009', 'b1c708ac-2c99-40d5-a671-904fbba75aa9', '65da7620-50c9-4ff6-94f2-1a13f73a43ed'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-65ebf718-1de4-47ab-8415-ee94bddaf23c tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "cinder-quobyte-b1c8cf55-a991-4956-bd11-63cd20912425" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-65ebf718-1de4-47ab-8415-ee94bddaf23c tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-quobyte-b1c8cf55-a991-4956-bd11-63cd20912425" acquired by "delete_volume" :: waited 0.031s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa08ea8-64eb-4800-bb76-3bc024b87377]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-65ebf718-1de4-47ab-8415-ee94bddaf23c tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1c8cf55-a991-4956-bd11-63cd20912425 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:57 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3c89b1e9-e3ed-4223-8d58-619d73865b88 tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.393s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-3c89b1e9-e3ed-4223-8d58-619d73865b88 tempest-CreateVolumesFromSnapshotTest-556812329 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cd2ba132-7c90-4027-a83c-9c61a48441b2 tempest-ProjectReaderTests-1973586254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cd2ba132-7c90-4027-a83c-9c61a48441b2 tempest-ProjectReaderTests-1973586254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ba132-7c90-4027-a83c-9c61a48441b2 tempest-ProjectReaderTests-1973586254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ba132-7c90-4027-a83c-9c61a48441b2 tempest-ProjectReaderTests-1973586254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-cd2ba132-7c90-4027-a83c-9c61a48441b2 tempest-ProjectReaderTests-1973586254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cd2ba132-7c90-4027-a83c-9c61a48441b2 tempest-ProjectReaderTests-1973586254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:57 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-3c89b1e9-e3ed-4223-8d58-619d73865b88 tempest-CreateVolumesFromSnapshotTest-556812329 None] Deleted volume successfully. Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:23:57 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:23:57 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Flow 'volume_create_manager' (970c8694-7893-4d71-bed7-93c29755fab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f0eed4b-be09-41e3-9e10-efd3c2335e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:57 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1c8cf55-a991-4956-bd11-63cd20912425 Sep 06 08:23:57 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3c89b1e9-e3ed-4223-8d58-619d73865b88 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-104b39e7-afbe-48b7-a29d-7fff3c852712-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f0eed4b-be09-41e3-9e10-efd3c2335e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bec405e-7cb2-4733-8f66-51294838493e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97b982bb6512441e9c9597f75a491f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:57Z,use_quota=True,user_id='bacf4de078304516942a3cf0ebae543b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f712ca-7b03-4825-b09a-05fdbec4ce86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f712ca-7b03-4825-b09a-05fdbec4ce86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d6ed45-bf90-4701-9b1e-69d78f3ecab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG cinder.image.glance [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Creating Keystone auth plugin from conf {{(pid=87307) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 08:23:57 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-cd2ba132-7c90-4027-a83c-9c61a48441b2 tempest-ProjectReaderTests-1973586254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.387s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-cd2ba132-7c90-4027-a83c-9c61a48441b2 tempest-ProjectReaderTests-1973586254 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:23:57 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-cd2ba132-7c90-4027-a83c-9c61a48441b2 tempest-ProjectReaderTests-1973586254 None] Deleted volume successfully. Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a4f6f368-920c-4e68-b555-8151626a48aa tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a4f6f368-920c-4e68-b555-8151626a48aa tempest-ProjectMemberTests-219511464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-a4f6f368-920c-4e68-b555-8151626a48aa tempest-ProjectMemberTests-219511464 None] Creating offline snapshot eaa4d595-c106-4d98-b63d-fb841822e5b1 of volume ce048414-09e4-42fe-9907-74770924e56b {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-cd2ba132-7c90-4027-a83c-9c61a48441b2 tempest-ProjectReaderTests-1973586254 None] Lock "cinder-0323ce55-0533-4d5a-89d8-4564e69806f4-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdbdd2c-5640-431f-aabc-15fafbb33b3f]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a4f6f368-920c-4e68-b555-8151626a48aa tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:58 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-65ebf718-1de4-47ab-8415-ee94bddaf23c tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1c8cf55-a991-4956-bd11-63cd20912425" returned: 0 in 0.606s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-65ebf718-1de4-47ab-8415-ee94bddaf23c tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1c8cf55-a991-4956-bd11-63cd20912425 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:58 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1c8cf55-a991-4956-bd11-63cd20912425 Sep 06 08:23:58 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:58 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b Sep 06 08:23:58 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d6ed45-bf90-4701-9b1e-69d78f3ecab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5bec405e-7cb2-4733-8f66-51294838493e', 'volume_name': 'volume-5bec405e-7cb2-4733-8f66-51294838493e', 'volume_size': 1, 'image_id': '0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '490aebf7762da36f43a2b2635965a5c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '97b982bb6512441e9c9597f75a491f01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fb79a13bb3d2a42faf9b35dd6f0ba98630f5019216a153e25193d1cf6c7574c81484a935c1f4a0ba8f0291d869bb3499ffbd959e213d41be7487d71e101495c0', 'id': '0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c', 'created_at': datetime.datetime(2026, 9, 6, 6, 23, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 6, 23, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c/file', 'properties': {}}, 'image_service': }' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ee89b4-9c80-454e-94b2-174584ecbf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ee89b4-9c80-454e-94b2-174584ecbf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c34a3a-ae23-41e6-b15f-cec039be3ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:23:58 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Volume 5bec405e-7cb2-4733-8f66-51294838493e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5bec405e-7cb2-4733-8f66-51294838493e', 'volume_size': 1, 'image_id': '0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '490aebf7762da36f43a2b2635965a5c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '97b982bb6512441e9c9597f75a491f01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fb79a13bb3d2a42faf9b35dd6f0ba98630f5019216a153e25193d1cf6c7574c81484a935c1f4a0ba8f0291d869bb3499ffbd959e213d41be7487d71e101495c0', 'id': '0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c', 'created_at': datetime.datetime(2026, 9, 6, 6, 23, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 6, 23, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c/file', 'properties': {}}, 'image_service': } Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Trying to clone 5bec405e-7cb2-4733-8f66-51294838493e from image 0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c at location (None, [{'url': 'file:///opt/stack/data/glance/images/0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c', 'metadata': {}}]). {{(pid=87307) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 08:23:58 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-65ebf718-1de4-47ab-8415-ee94bddaf23c tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-b1c8cf55-a991-4956-bd11-63cd20912425" returned: 0 in 0.364s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:58 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a4f6f368-920c-4e68-b555-8151626a48aa tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b" returned: 0 in 0.463s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a4f6f368-920c-4e68-b555-8151626a48aa tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.eaa4d595-c106-4d98-b63d-fb841822e5b1 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-65ebf718-1de4-47ab-8415-ee94bddaf23c tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-quobyte-b1c8cf55-a991-4956-bd11-63cd20912425" released by "delete_volume" :: held 1.044s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 08:23:58 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Image download 0.00 MB at 0.00 MB/s Sep 06 08:23:58 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.eaa4d595-c106-4d98-b63d-fb841822e5b1 1G Sep 06 08:23:58 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-65ebf718-1de4-47ab-8415-ee94bddaf23c tempest-CreateVolumesFromSnapshotTest-556812329 None] Created reservations ['b5eb9fb5-9db4-4604-ae59-587e6324992f', '5d3ef160-acc4-41a8-aed5-bd7e734a07d9', '30831e62-0035-4e99-876b-fd9113d7010d', '2490911d-d30a-416e-a9b6-5c9fae190fb3'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e2ead9-ac11-431a-bbfe-333707d58abd]: (4, 'raw') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-65ebf718-1de4-47ab-8415-ee94bddaf23c tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-65ebf718-1de4-47ab-8415-ee94bddaf23c tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-65ebf718-1de4-47ab-8415-ee94bddaf23c tempest-CreateVolumesFromSnapshotTest-556812329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-65ebf718-1de4-47ab-8415-ee94bddaf23c tempest-CreateVolumesFromSnapshotTest-556812329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-65ebf718-1de4-47ab-8415-ee94bddaf23c tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-65ebf718-1de4-47ab-8415-ee94bddaf23c tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:58 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD Sep 06 08:23:58 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:58 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:23:58 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:58 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a4f6f368-920c-4e68-b555-8151626a48aa tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.eaa4d595-c106-4d98-b63d-fb841822e5b1 1G" returned: 0 in 0.468s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a4f6f368-920c-4e68-b555-8151626a48aa tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce048414-09e4-42fe-9907-74770924e56b -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.eaa4d595-c106-4d98-b63d-fb841822e5b1 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:58 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce048414-09e4-42fe-9907-74770924e56b -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.eaa4d595-c106-4d98-b63d-fb841822e5b1 Sep 06 08:23:58 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:58 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD" returned: 0 in 0.428s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:58 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-65ebf718-1de4-47ab-8415-ee94bddaf23c tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.333s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:58 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-65ebf718-1de4-47ab-8415-ee94bddaf23c tempest-CreateVolumesFromSnapshotTest-556812329 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:23:59 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-65ebf718-1de4-47ab-8415-ee94bddaf23c tempest-CreateVolumesFromSnapshotTest-556812329 None] Deleted volume successfully. Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-65ebf718-1de4-47ab-8415-ee94bddaf23c tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-b1c8cf55-a991-4956-bd11-63cd20912425-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:23:59 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD Sep 06 08:23:59 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:59 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a4f6f368-920c-4e68-b555-8151626a48aa tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce048414-09e4-42fe-9907-74770924e56b -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.eaa4d595-c106-4d98-b63d-fb841822e5b1" returned: 0 in 0.368s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:59 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-a4f6f368-920c-4e68-b555-8151626a48aa tempest-ProjectMemberTests-219511464 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.eaa4d595-c106-4d98-b63d-fb841822e5b1 is being set with open permissions: ugo+rw Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a4f6f368-920c-4e68-b555-8151626a48aa tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.eaa4d595-c106-4d98-b63d-fb841822e5b1 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:59 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.eaa4d595-c106-4d98-b63d-fb841822e5b1 Sep 06 08:23:59 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:59 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD" returned: 1 in 0.359s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Temporary image 0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c is fetched for user bacf4de078304516942a3cf0ebae543b. {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d98b1b-0972-4861-a7d1-eca5be5192de]: (4, 'raw') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:59 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD Sep 06 08:23:59 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:59 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a4f6f368-920c-4e68-b555-8151626a48aa tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.eaa4d595-c106-4d98-b63d-fb841822e5b1" returned: 0 in 0.303s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a4f6f368-920c-4e68-b555-8151626a48aa tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6b1704ef-2412-4d1a-9ed4-88edd683aa9d tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "cinder-549d13a5-1bbb-4dcd-af28-c2d17ca41fd2-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:59 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.info Sep 06 08:23:59 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6b1704ef-2412-4d1a-9ed4-88edd683aa9d tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-549d13a5-1bbb-4dcd-af28-c2d17ca41fd2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:59 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:23:59 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6b1704ef-2412-4d1a-9ed4-88edd683aa9d tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "cinder-quobyte-549d13a5-1bbb-4dcd-af28-c2d17ca41fd2" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:23:59 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6b1704ef-2412-4d1a-9ed4-88edd683aa9d tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-quobyte-549d13a5-1bbb-4dcd-af28-c2d17ca41fd2" acquired by "delete_volume" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD" returned: 0 in 0.449s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[accaf8af-b738-45fb-aade-bfac5623e59a]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6b1704ef-2412-4d1a-9ed4-88edd683aa9d tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-549d13a5-1bbb-4dcd-af28-c2d17ca41fd2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:23:59 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a4f6f368-920c-4e68-b555-8151626a48aa tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.info" returned: 0 in 0.355s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:23:59 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-a4f6f368-920c-4e68-b555-8151626a48aa tempest-ProjectMemberTests-219511464 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.info is being set with open permissions: ugo+rw Sep 06 08:23:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a4f6f368-920c-4e68-b555-8151626a48aa tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:00 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.326s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager._thread_info {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread count: 28 {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 08:24:00 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.info Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread info: [<_MainThread(MainThread, started 139985167040640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:24:00 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:00 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD Sep 06 08:24:00 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:00 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-549d13a5-1bbb-4dcd-af28-c2d17ca41fd2 Sep 06 08:24:00 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:00 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a4f6f368-920c-4e68-b555-8151626a48aa tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.info" returned: 0 in 0.272s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a4f6f368-920c-4e68-b555-8151626a48aa tempest-ProjectMemberTests-219511464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.357s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:00 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-a4f6f368-920c-4e68-b555-8151626a48aa tempest-ProjectMemberTests-219511464 None] Create snapshot completed successfully Sep 06 08:24:00 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD" returned: 1 in 0.431s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bec405e-7cb2-4733-8f66-51294838493e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97b982bb6512441e9c9597f75a491f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:23:57Z,use_quota=True,user_id='bacf4de078304516942a3cf0ebae543b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Creating volume 5bec405e-7cb2-4733-8f66-51294838493e {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:24:00 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5bec405e-7cb2-4733-8f66-51294838493e 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:00 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5bec405e-7cb2-4733-8f66-51294838493e 1073741824 Sep 06 08:24:00 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:00 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6b1704ef-2412-4d1a-9ed4-88edd683aa9d tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-549d13a5-1bbb-4dcd-af28-c2d17ca41fd2" returned: 0 in 0.503s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6b1704ef-2412-4d1a-9ed4-88edd683aa9d tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-549d13a5-1bbb-4dcd-af28-c2d17ca41fd2 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:00 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-549d13a5-1bbb-4dcd-af28-c2d17ca41fd2 Sep 06 08:24:00 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:00 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6b1704ef-2412-4d1a-9ed4-88edd683aa9d tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-549d13a5-1bbb-4dcd-af28-c2d17ca41fd2" returned: 0 in 0.295s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6b1704ef-2412-4d1a-9ed4-88edd683aa9d tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-quobyte-549d13a5-1bbb-4dcd-af28-c2d17ca41fd2" released by "delete_volume" :: held 0.856s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-6b1704ef-2412-4d1a-9ed4-88edd683aa9d tempest-CreateVolumesFromSnapshotTest-556812329 None] Created reservations ['c66c2f9f-aa84-4ba5-ae95-8859674be96b', 'f1fff616-2441-4311-aff8-da5b68dd43d8', 'f8f52001-1f04-446b-bb34-5cb4f1610aa7', '82db7c39-d261-43fa-a261-7a1ae68ba0ef'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:00 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5bec405e-7cb2-4733-8f66-51294838493e 1073741824" returned: 0 in 0.528s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6b1704ef-2412-4d1a-9ed4-88edd683aa9d tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6b1704ef-2412-4d1a-9ed4-88edd683aa9d tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6b1704ef-2412-4d1a-9ed4-88edd683aa9d tempest-CreateVolumesFromSnapshotTest-556812329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6b1704ef-2412-4d1a-9ed4-88edd683aa9d tempest-CreateVolumesFromSnapshotTest-556812329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6b1704ef-2412-4d1a-9ed4-88edd683aa9d tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6b1704ef-2412-4d1a-9ed4-88edd683aa9d tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:00 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:24:00 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5bec405e-7cb2-4733-8f66-51294838493e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:00 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5bec405e-7cb2-4733-8f66-51294838493e Sep 06 08:24:00 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2e9e7b43-4c48-4a2e-b729-399c3e362358 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-eaa4d595-c106-4d98-b63d-fb841822e5b1-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2e9e7b43-4c48-4a2e-b729-399c3e362358 tempest-ProjectMemberTests-219511464 None] Lock "cinder-eaa4d595-c106-4d98-b63d-fb841822e5b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2e9e7b43-4c48-4a2e-b729-399c3e362358 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-ce048414-09e4-42fe-9907-74770924e56b" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2e9e7b43-4c48-4a2e-b729-399c3e362358 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-ce048414-09e4-42fe-9907-74770924e56b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2e9e7b43-4c48-4a2e-b729-399c3e362358 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-eaa4d595-c106-4d98-b63d-fb841822e5b1" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2e9e7b43-4c48-4a2e-b729-399c3e362358 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-eaa4d595-c106-4d98-b63d-fb841822e5b1" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-2e9e7b43-4c48-4a2e-b729-399c3e362358 tempest-ProjectMemberTests-219511464 None] Deleting offline snapshot eaa4d595-c106-4d98-b63d-fb841822e5b1 of volume ce048414-09e4-42fe-9907-74770924e56b {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-2e9e7b43-4c48-4a2e-b729-399c3e362358 tempest-ProjectMemberTests-219511464 None] snapshot_file for this snap is: volume-ce048414-09e4-42fe-9907-74770924e56b.eaa4d595-c106-4d98-b63d-fb841822e5b1 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[206f4104-de73-4ba6-81e3-ef3d2deb20ef]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2e9e7b43-4c48-4a2e-b729-399c3e362358 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.eaa4d595-c106-4d98-b63d-fb841822e5b1 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:01 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5bec405e-7cb2-4733-8f66-51294838493e" returned: 0 in 0.330s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:01 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6b1704ef-2412-4d1a-9ed4-88edd683aa9d tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.384s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6b1704ef-2412-4d1a-9ed4-88edd683aa9d tempest-CreateVolumesFromSnapshotTest-556812329 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:24:01 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-6b1704ef-2412-4d1a-9ed4-88edd683aa9d tempest-CreateVolumesFromSnapshotTest-556812329 None] Deleted volume successfully. Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6b1704ef-2412-4d1a-9ed4-88edd683aa9d tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-549d13a5-1bbb-4dcd-af28-c2d17ca41fd2-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Attempting download of 0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c ((None, [{'url': 'file:///opt/stack/data/glance/images/0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c', 'metadata': {}}])) to volume 5bec405e-7cb2-4733-8f66-51294838493e. {{(pid=87307) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0711b38e-feeb-47ec-acec-30a8a8cad9b1]: (4, 'raw') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_0axa5_nq {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:01 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.eaa4d595-c106-4d98-b63d-fb841822e5b1 Sep 06 08:24:01 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:01 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_0axa5_nq Sep 06 08:24:01 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:01 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2e9e7b43-4c48-4a2e-b729-399c3e362358 tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.eaa4d595-c106-4d98-b63d-fb841822e5b1" returned: 0 in 0.460s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-2e9e7b43-4c48-4a2e-b729-399c3e362358 tempest-ProjectMemberTests-219511464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce048414-09e4-42fe-9907-74770924e56b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[68493f68-d0fe-4544-92cc-72585352d425]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2e9e7b43-4c48-4a2e-b729-399c3e362358 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:01 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_0axa5_nq" returned: 0 in 0.390s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_0axa5_nq {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:01 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b Sep 06 08:24:01 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:01 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_0axa5_nq Sep 06 08:24:01 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ed856c9-3a7d-456b-9bc3-4a940cb90be6 tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "cinder-3112eade-bb31-4629-b0cd-03dd24bb413b-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ed856c9-3a7d-456b-9bc3-4a940cb90be6 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-3112eade-bb31-4629-b0cd-03dd24bb413b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ed856c9-3a7d-456b-9bc3-4a940cb90be6 tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "cinder-quobyte-3112eade-bb31-4629-b0cd-03dd24bb413b" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ed856c9-3a7d-456b-9bc3-4a940cb90be6 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-quobyte-3112eade-bb31-4629-b0cd-03dd24bb413b" acquired by "delete_volume" :: waited 0.021s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:02 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e83114-e35d-4b4c-839d-df87f4e792d7]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ed856c9-3a7d-456b-9bc3-4a940cb90be6 tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3112eade-bb31-4629-b0cd-03dd24bb413b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:02 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_0axa5_nq" returned: 1 in 0.374s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_0axa5_nq' failed. Not Retrying. {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 08:24:02 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ef4b73-a990-4894-99bb-3e194465ba51]: (4, 'raw') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:02 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2e9e7b43-4c48-4a2e-b729-399c3e362358 tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b" returned: 0 in 0.491s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2e9e7b43-4c48-4a2e-b729-399c3e362358 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.eaa4d595-c106-4d98-b63d-fb841822e5b1 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:02 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3112eade-bb31-4629-b0cd-03dd24bb413b Sep 06 08:24:02 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:02 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.eaa4d595-c106-4d98-b63d-fb841822e5b1 Sep 06 08:24:02 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:02 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD Sep 06 08:24:02 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:02 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ed856c9-3a7d-456b-9bc3-4a940cb90be6 tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3112eade-bb31-4629-b0cd-03dd24bb413b" returned: 0 in 0.498s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ed856c9-3a7d-456b-9bc3-4a940cb90be6 tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3112eade-bb31-4629-b0cd-03dd24bb413b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:02 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD" returned: 0 in 0.442s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:02 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3112eade-bb31-4629-b0cd-03dd24bb413b Sep 06 08:24:02 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:02 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD Sep 06 08:24:02 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:02 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2e9e7b43-4c48-4a2e-b729-399c3e362358 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.eaa4d595-c106-4d98-b63d-fb841822e5b1" returned: 0 in 0.545s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2e9e7b43-4c48-4a2e-b729-399c3e362358 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.eaa4d595-c106-4d98-b63d-fb841822e5b1 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:02 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.eaa4d595-c106-4d98-b63d-fb841822e5b1 Sep 06 08:24:02 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:02 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ed856c9-3a7d-456b-9bc3-4a940cb90be6 tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-3112eade-bb31-4629-b0cd-03dd24bb413b" returned: 0 in 0.300s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ed856c9-3a7d-456b-9bc3-4a940cb90be6 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-quobyte-3112eade-bb31-4629-b0cd-03dd24bb413b" released by "delete_volume" :: held 0.859s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:02 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-0ed856c9-3a7d-456b-9bc3-4a940cb90be6 tempest-CreateVolumesFromSnapshotTest-556812329 None] Created reservations ['2c7791fd-9ab8-423d-adff-cc6266f195fd', 'a0153435-9b3e-4675-8042-32627347a805', '28af6b2c-11af-4ae3-bbe2-e3fc4381642e', '369fba8c-b81c-488a-b00f-7cd5d50b8f92'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:03 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0ed856c9-3a7d-456b-9bc3-4a940cb90be6 tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0ed856c9-3a7d-456b-9bc3-4a940cb90be6 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0ed856c9-3a7d-456b-9bc3-4a940cb90be6 tempest-CreateVolumesFromSnapshotTest-556812329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0ed856c9-3a7d-456b-9bc3-4a940cb90be6 tempest-CreateVolumesFromSnapshotTest-556812329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0ed856c9-3a7d-456b-9bc3-4a940cb90be6 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ed856c9-3a7d-456b-9bc3-4a940cb90be6 tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD" returned: 1 in 0.454s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] 0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c was raw, converting to qcow2 {{(pid=87307) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5bec405e-7cb2-4733-8f66-51294838493e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:03 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2e9e7b43-4c48-4a2e-b729-399c3e362358 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b.eaa4d595-c106-4d98-b63d-fb841822e5b1" returned: 0 in 0.306s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:03 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:24:03 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:03 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5bec405e-7cb2-4733-8f66-51294838493e Sep 06 08:24:03 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2e9e7b43-4c48-4a2e-b729-399c3e362358 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-eaa4d595-c106-4d98-b63d-fb841822e5b1" released by "_delete_snapshot" :: held 1.956s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a9df5596-5830-44bf-96c4-64fd2b88a4ff tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "cinder-d7fe3ede-e853-4b08-bcdb-ef848e80dc9f-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2e9e7b43-4c48-4a2e-b729-399c3e362358 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-ce048414-09e4-42fe-9907-74770924e56b" released by "delete_snapshot" :: held 2.014s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a9df5596-5830-44bf-96c4-64fd2b88a4ff tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-d7fe3ede-e853-4b08-bcdb-ef848e80dc9f-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a9df5596-5830-44bf-96c4-64fd2b88a4ff tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "cinder-quobyte-d7fe3ede-e853-4b08-bcdb-ef848e80dc9f" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-2e9e7b43-4c48-4a2e-b729-399c3e362358 tempest-ProjectMemberTests-219511464 None] Created reservations ['c9f1b88c-a603-4432-907f-8885f3a5bf6e', '4bac4fb5-88e1-442b-bd78-99142a37aea9', 'e46c5b5c-0586-4b4f-94d6-4b6b3a88fd58', 'ab0358f0-2ef5-4aa1-ad8e-1f13e04a01b1'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a9df5596-5830-44bf-96c4-64fd2b88a4ff tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-quobyte-d7fe3ede-e853-4b08-bcdb-ef848e80dc9f" acquired by "delete_volume" :: waited 0.032s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d205d6ab-293c-403f-904a-9c539d44e25d]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a9df5596-5830-44bf-96c4-64fd2b88a4ff tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d7fe3ede-e853-4b08-bcdb-ef848e80dc9f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:03 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0ed856c9-3a7d-456b-9bc3-4a940cb90be6 tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.391s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-0ed856c9-3a7d-456b-9bc3-4a940cb90be6 tempest-CreateVolumesFromSnapshotTest-556812329 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:24:03 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-0ed856c9-3a7d-456b-9bc3-4a940cb90be6 tempest-CreateVolumesFromSnapshotTest-556812329 None] Deleted volume successfully. Sep 06 08:24:03 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-2e9e7b43-4c48-4a2e-b729-399c3e362358 tempest-ProjectMemberTests-219511464 None] Delete snapshot completed successfully. Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2e9e7b43-4c48-4a2e-b729-399c3e362358 tempest-ProjectMemberTests-219511464 None] Lock "cinder-eaa4d595-c106-4d98-b63d-fb841822e5b1-delete_snapshot" released by "delete_snapshot" :: held 2.358s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-0ed856c9-3a7d-456b-9bc3-4a940cb90be6 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-3112eade-bb31-4629-b0cd-03dd24bb413b-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:03 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d7fe3ede-e853-4b08-bcdb-ef848e80dc9f Sep 06 08:24:03 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:03 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5bec405e-7cb2-4733-8f66-51294838493e" returned: 0 in 0.650s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c_qk3_wwy1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5bec405e-7cb2-4733-8f66-51294838493e {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:24:03 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Converted 0.00 MB image at 0.00 MB/s Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5bec405e-7cb2-4733-8f66-51294838493e 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:03 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5bec405e-7cb2-4733-8f66-51294838493e 1G Sep 06 08:24:03 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:03 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a9df5596-5830-44bf-96c4-64fd2b88a4ff tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d7fe3ede-e853-4b08-bcdb-ef848e80dc9f" returned: 0 in 0.456s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a9df5596-5830-44bf-96c4-64fd2b88a4ff tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d7fe3ede-e853-4b08-bcdb-ef848e80dc9f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:03 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d7fe3ede-e853-4b08-bcdb-ef848e80dc9f Sep 06 08:24:03 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:04 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5bec405e-7cb2-4733-8f66-51294838493e 1G" returned: 0 in 0.356s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Downloaded image 0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c ((None, [{'url': 'file:///opt/stack/data/glance/images/0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c', 'metadata': {}}])) to volume 5bec405e-7cb2-4733-8f66-51294838493e successfully. {{(pid=87307) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Temporary image 0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c for user bacf4de078304516942a3cf0ebae543b is deleted. {{(pid=87307) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.volume.volume_utils [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Marking volume 5bec405e-7cb2-4733-8f66-51294838493e as bootable. {{(pid=87307) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Copying metadata from image 0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c to 5bec405e-7cb2-4733-8f66-51294838493e. {{(pid=87307) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Creating volume glance metadata for volume 5bec405e-7cb2-4733-8f66-51294838493e backed by image 0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c with: {'image_id': '0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '490aebf7762da36f43a2b2635965a5c9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87307) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 08:24:04 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a9df5596-5830-44bf-96c4-64fd2b88a4ff tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d7fe3ede-e853-4b08-bcdb-ef848e80dc9f" returned: 0 in 0.291s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a9df5596-5830-44bf-96c4-64fd2b88a4ff tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-quobyte-d7fe3ede-e853-4b08-bcdb-ef848e80dc9f" released by "delete_volume" :: held 0.803s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c34a3a-ae23-41e6-b15f-cec039be3ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bec405e-7cb2-4733-8f66-51294838493e', 'volume_size': 1, 'image_id': '0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '490aebf7762da36f43a2b2635965a5c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '97b982bb6512441e9c9597f75a491f01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fb79a13bb3d2a42faf9b35dd6f0ba98630f5019216a153e25193d1cf6c7574c81484a935c1f4a0ba8f0291d869bb3499ffbd959e213d41be7487d71e101495c0', 'id': '0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c', 'created_at': datetime.datetime(2026, 9, 6, 6, 23, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 6, 23, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a04e8fa-c1a9-42e5-8e16-1d32636f0d2c/file', 'properties': {}}, 'image_service': }' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef4f2d9-0bc3-4176-af80-65ed588fcd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:04 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Volume volume-5bec405e-7cb2-4733-8f66-51294838493e (5bec405e-7cb2-4733-8f66-51294838493e): created successfully Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef4f2d9-0bc3-4176-af80-65ed588fcd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Flow 'volume_create_manager' (970c8694-7893-4d71-bed7-93c29755fab4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-a9df5596-5830-44bf-96c4-64fd2b88a4ff tempest-CreateVolumesFromSnapshotTest-556812329 None] Created reservations ['d5bf9ac1-1583-4977-af82-376273e7e84a', '937c16eb-c7bb-4160-921d-0358bd8023e1', '7da58b75-bcad-40f2-bd77-c689e4cff11d', '302fc833-69ea-4b69-97c9-e001c32c59d3'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:04 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-435d6423-a7e7-4152-bdfd-e900d01e24bc tempest-VolumeImageDependencyTests-206244778 None] Created volume successfully. Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a9df5596-5830-44bf-96c4-64fd2b88a4ff tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a9df5596-5830-44bf-96c4-64fd2b88a4ff tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a9df5596-5830-44bf-96c4-64fd2b88a4ff tempest-CreateVolumesFromSnapshotTest-556812329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-a9df5596-5830-44bf-96c4-64fd2b88a4ff tempest-CreateVolumesFromSnapshotTest-556812329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-a9df5596-5830-44bf-96c4-64fd2b88a4ff tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a9df5596-5830-44bf-96c4-64fd2b88a4ff tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:04 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:24:04 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-d7f09d99-cd59-45b7-a0c2-b21e49d2a280 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-ce048414-09e4-42fe-9907-74770924e56b-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-5f8de6b1-8d75-4c95-8bed-0c4747f9c62c tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "cinder-c0cbd750-7aa2-4efc-bbb0-57d950a70fb7-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-d7f09d99-cd59-45b7-a0c2-b21e49d2a280 tempest-ProjectMemberTests-219511464 None] Lock "cinder-ce048414-09e4-42fe-9907-74770924e56b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-5f8de6b1-8d75-4c95-8bed-0c4747f9c62c tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-c0cbd750-7aa2-4efc-bbb0-57d950a70fb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-5f8de6b1-8d75-4c95-8bed-0c4747f9c62c tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "cinder-quobyte-e9019c40-9cf9-48b0-949a-4afb70468647" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-5f8de6b1-8d75-4c95-8bed-0c4747f9c62c tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-quobyte-e9019c40-9cf9-48b0-949a-4afb70468647" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-5f8de6b1-8d75-4c95-8bed-0c4747f9c62c tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "cinder-quobyte-c0cbd750-7aa2-4efc-bbb0-57d950a70fb7" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-5f8de6b1-8d75-4c95-8bed-0c4747f9c62c tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-quobyte-c0cbd750-7aa2-4efc-bbb0-57d950a70fb7" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-5f8de6b1-8d75-4c95-8bed-0c4747f9c62c tempest-CreateVolumesFromSnapshotTest-556812329 None] Deleting offline snapshot c0cbd750-7aa2-4efc-bbb0-57d950a70fb7 of volume e9019c40-9cf9-48b0-949a-4afb70468647 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-5f8de6b1-8d75-4c95-8bed-0c4747f9c62c tempest-CreateVolumesFromSnapshotTest-556812329 None] snapshot_file for this snap is: volume-e9019c40-9cf9-48b0-949a-4afb70468647.c0cbd750-7aa2-4efc-bbb0-57d950a70fb7 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-d7f09d99-cd59-45b7-a0c2-b21e49d2a280 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-ce048414-09e4-42fe-9907-74770924e56b" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc664ee5-84fd-474a-9bb4-720a2476d02b]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-d7f09d99-cd59-45b7-a0c2-b21e49d2a280 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-ce048414-09e4-42fe-9907-74770924e56b" acquired by "delete_volume" :: waited 0.023s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5f8de6b1-8d75-4c95-8bed-0c4747f9c62c tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.c0cbd750-7aa2-4efc-bbb0-57d950a70fb7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a539875a-97f1-4278-a67b-224238f3c127]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d7f09d99-cd59-45b7-a0c2-b21e49d2a280 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:04 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-a9df5596-5830-44bf-96c4-64fd2b88a4ff tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.334s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-a9df5596-5830-44bf-96c4-64fd2b88a4ff tempest-CreateVolumesFromSnapshotTest-556812329 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:24:04 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-a9df5596-5830-44bf-96c4-64fd2b88a4ff tempest-CreateVolumesFromSnapshotTest-556812329 None] Deleted volume successfully. Sep 06 08:24:04 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-a9df5596-5830-44bf-96c4-64fd2b88a4ff tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-d7fe3ede-e853-4b08-bcdb-ef848e80dc9f-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:04 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.c0cbd750-7aa2-4efc-bbb0-57d950a70fb7 Sep 06 08:24:04 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:04 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b Sep 06 08:24:04 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-58dd5091-8919-435b-a8d7-9d6f530a2465 tempest-VolumeImageDependencyTests-206244778 None] Acquiring lock "cinder-5bec405e-7cb2-4733-8f66-51294838493e-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-58dd5091-8919-435b-a8d7-9d6f530a2465 tempest-VolumeImageDependencyTests-206244778 None] Lock "cinder-5bec405e-7cb2-4733-8f66-51294838493e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:05 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5f8de6b1-8d75-4c95-8bed-0c4747f9c62c tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.c0cbd750-7aa2-4efc-bbb0-57d950a70fb7" returned: 0 in 0.498s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-5f8de6b1-8d75-4c95-8bed-0c4747f9c62c tempest-CreateVolumesFromSnapshotTest-556812329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9019c40-9cf9-48b0-949a-4afb70468647(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a83fa88-e113-4bf5-b8f4-be20766bd7cf]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5f8de6b1-8d75-4c95-8bed-0c4747f9c62c tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:05 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d7f09d99-cd59-45b7-a0c2-b21e49d2a280 tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b" returned: 0 in 0.561s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d7f09d99-cd59-45b7-a0c2-b21e49d2a280 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-58dd5091-8919-435b-a8d7-9d6f530a2465 tempest-VolumeImageDependencyTests-206244778 None] Acquiring lock "cinder-quobyte-5bec405e-7cb2-4733-8f66-51294838493e" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:05 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b Sep 06 08:24:05 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-58dd5091-8919-435b-a8d7-9d6f530a2465 tempest-VolumeImageDependencyTests-206244778 None] Lock "cinder-quobyte-5bec405e-7cb2-4733-8f66-51294838493e" acquired by "delete_volume" :: waited 0.028s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5e4171-f2ca-4408-b35d-e1383cac9764]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-58dd5091-8919-435b-a8d7-9d6f530a2465 tempest-VolumeImageDependencyTests-206244778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5bec405e-7cb2-4733-8f66-51294838493e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:05 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647 Sep 06 08:24:05 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:05 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5bec405e-7cb2-4733-8f66-51294838493e Sep 06 08:24:05 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:05 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d7f09d99-cd59-45b7-a0c2-b21e49d2a280 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ce048414-09e4-42fe-9907-74770924e56b" returned: 0 in 0.292s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-d7f09d99-cd59-45b7-a0c2-b21e49d2a280 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-ce048414-09e4-42fe-9907-74770924e56b" released by "delete_volume" :: held 0.938s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-d7f09d99-cd59-45b7-a0c2-b21e49d2a280 tempest-ProjectMemberTests-219511464 None] Created reservations ['44042a6c-99a7-421e-8620-f57a105ff5d4', 'c984d515-b629-42d5-841a-ada2c1f80121', '11f09dd5-490a-49ce-8850-98c60645886e', 'bf54c902-5637-4d5c-b5b0-da36c43ac2b2'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:05 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5f8de6b1-8d75-4c95-8bed-0c4747f9c62c tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647" returned: 0 in 0.495s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5f8de6b1-8d75-4c95-8bed-0c4747f9c62c tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.c0cbd750-7aa2-4efc-bbb0-57d950a70fb7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:05 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.c0cbd750-7aa2-4efc-bbb0-57d950a70fb7 Sep 06 08:24:05 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d7f09d99-cd59-45b7-a0c2-b21e49d2a280 tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d7f09d99-cd59-45b7-a0c2-b21e49d2a280 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d7f09d99-cd59-45b7-a0c2-b21e49d2a280 tempest-ProjectMemberTests-219511464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d7f09d99-cd59-45b7-a0c2-b21e49d2a280 tempest-ProjectMemberTests-219511464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d7f09d99-cd59-45b7-a0c2-b21e49d2a280 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d7f09d99-cd59-45b7-a0c2-b21e49d2a280 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:05 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:24:05 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:05 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-58dd5091-8919-435b-a8d7-9d6f530a2465 tempest-VolumeImageDependencyTests-206244778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5bec405e-7cb2-4733-8f66-51294838493e" returned: 0 in 0.472s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-58dd5091-8919-435b-a8d7-9d6f530a2465 tempest-VolumeImageDependencyTests-206244778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5bec405e-7cb2-4733-8f66-51294838493e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:05 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5bec405e-7cb2-4733-8f66-51294838493e Sep 06 08:24:05 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:06 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d7f09d99-cd59-45b7-a0c2-b21e49d2a280 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.314s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:06 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-d7f09d99-cd59-45b7-a0c2-b21e49d2a280 tempest-ProjectMemberTests-219511464 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:24:06 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-d7f09d99-cd59-45b7-a0c2-b21e49d2a280 tempest-ProjectMemberTests-219511464 None] Deleted volume successfully. Sep 06 08:24:06 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:06 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5f8de6b1-8d75-4c95-8bed-0c4747f9c62c tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.c0cbd750-7aa2-4efc-bbb0-57d950a70fb7" returned: 0 in 0.421s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5f8de6b1-8d75-4c95-8bed-0c4747f9c62c tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.c0cbd750-7aa2-4efc-bbb0-57d950a70fb7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-d7f09d99-cd59-45b7-a0c2-b21e49d2a280 tempest-ProjectMemberTests-219511464 None] Lock "cinder-ce048414-09e4-42fe-9907-74770924e56b-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-58dd5091-8919-435b-a8d7-9d6f530a2465 tempest-VolumeImageDependencyTests-206244778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-5bec405e-7cb2-4733-8f66-51294838493e" returned: 0 in 0.327s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:06 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.c0cbd750-7aa2-4efc-bbb0-57d950a70fb7 Sep 06 08:24:06 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-58dd5091-8919-435b-a8d7-9d6f530a2465 tempest-VolumeImageDependencyTests-206244778 None] Lock "cinder-quobyte-5bec405e-7cb2-4733-8f66-51294838493e" released by "delete_volume" :: held 0.862s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:06 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-58dd5091-8919-435b-a8d7-9d6f530a2465 tempest-VolumeImageDependencyTests-206244778 None] Created reservations ['13a546e4-8c71-419e-9c41-919ad17cd357', 'e8c888f9-881e-44e3-acbb-17000519004e', '8521f580-a6ac-47ef-a523-e98e616b4678', '16786738-2b51-4ba8-bfa3-f94e05c50daa'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-58dd5091-8919-435b-a8d7-9d6f530a2465 tempest-VolumeImageDependencyTests-206244778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-58dd5091-8919-435b-a8d7-9d6f530a2465 tempest-VolumeImageDependencyTests-206244778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-58dd5091-8919-435b-a8d7-9d6f530a2465 tempest-VolumeImageDependencyTests-206244778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-58dd5091-8919-435b-a8d7-9d6f530a2465 tempest-VolumeImageDependencyTests-206244778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-58dd5091-8919-435b-a8d7-9d6f530a2465 tempest-VolumeImageDependencyTests-206244778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-58dd5091-8919-435b-a8d7-9d6f530a2465 tempest-VolumeImageDependencyTests-206244778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:06 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:24:06 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:06 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5f8de6b1-8d75-4c95-8bed-0c4747f9c62c tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647.c0cbd750-7aa2-4efc-bbb0-57d950a70fb7" returned: 0 in 0.281s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-5f8de6b1-8d75-4c95-8bed-0c4747f9c62c tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-quobyte-c0cbd750-7aa2-4efc-bbb0-57d950a70fb7" released by "_delete_snapshot" :: held 1.905s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-5f8de6b1-8d75-4c95-8bed-0c4747f9c62c tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-quobyte-e9019c40-9cf9-48b0-949a-4afb70468647" released by "delete_snapshot" :: held 1.958s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:06 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-5f8de6b1-8d75-4c95-8bed-0c4747f9c62c tempest-CreateVolumesFromSnapshotTest-556812329 None] Created reservations ['599a27cf-1b98-4e1a-84ac-735b23e42ad7', '4a25257e-3552-49b4-baab-732f2dc46f2e', '522f60cd-2e93-4e59-94e8-729be424263d', '1533f73b-c4a7-48d2-a16e-1afc7de2ac88'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:06 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-5f8de6b1-8d75-4c95-8bed-0c4747f9c62c tempest-CreateVolumesFromSnapshotTest-556812329 None] Delete snapshot completed successfully. Sep 06 08:24:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-5f8de6b1-8d75-4c95-8bed-0c4747f9c62c tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-c0cbd750-7aa2-4efc-bbb0-57d950a70fb7-delete_snapshot" released by "delete_snapshot" :: held 2.252s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:06 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-58dd5091-8919-435b-a8d7-9d6f530a2465 tempest-VolumeImageDependencyTests-206244778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.545s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:06 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-58dd5091-8919-435b-a8d7-9d6f530a2465 tempest-VolumeImageDependencyTests-206244778 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:24:06 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-58dd5091-8919-435b-a8d7-9d6f530a2465 tempest-VolumeImageDependencyTests-206244778 None] Deleted volume successfully. Sep 06 08:24:06 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:UPDATE=308,cinder:SELECT=226,cinder:INSERT=88,cinder:DELETE=23 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:24:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-58dd5091-8919-435b-a8d7-9d6f530a2465 tempest-VolumeImageDependencyTests-206244778 None] Lock "cinder-5bec405e-7cb2-4733-8f66-51294838493e-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=230,cinder:UPDATE=287,cinder:DELETE=29,cinder:INSERT=77 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Flow 'volume_create_manager' (89352b1b-06b7-48cb-bb5c-c00af660a468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db1cb604-fe95-4ede-8cbe-67f3070855f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db1cb604-fe95-4ede-8cbe-67f3070855f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1097321704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f05801fc-7dde-4e02-a7dd-340472f175fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57ff192bd0a74a27be0be1f1201231cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:07Z,use_quota=True,user_id='0f50a8b862534662bb877ccafabde4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d329ae9-9ecc-4c2c-8481-167d8aa9e4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d329ae9-9ecc-4c2c-8481-167d8aa9e4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9387089-62dc-4458-a6f1-f50d8c5958a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9387089-62dc-4458-a6f1-f50d8c5958a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f05801fc-7dde-4e02-a7dd-340472f175fb', 'volume_name': 'volume-f05801fc-7dde-4e02-a7dd-340472f175fb', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95bf9ab2-c08b-4394-b6c8-a19e3737f0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95bf9ab2-c08b-4394-b6c8-a19e3737f0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc5f145d-4ddd-4727-a0f7-0467aafc38a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:07 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Volume f05801fc-7dde-4e02-a7dd-340472f175fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f05801fc-7dde-4e02-a7dd-340472f175fb', 'volume_size': 1} Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1097321704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f05801fc-7dde-4e02-a7dd-340472f175fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57ff192bd0a74a27be0be1f1201231cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:07Z,use_quota=True,user_id='0f50a8b862534662bb877ccafabde4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Creating volume f05801fc-7dde-4e02-a7dd-340472f175fb {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:24:07 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:07 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb 1073741824 Sep 06 08:24:07 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6bc08533-506e-4cbd-a727-6a31c9e0fc90 tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "cinder-e9019c40-9cf9-48b0-949a-4afb70468647-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6bc08533-506e-4cbd-a727-6a31c9e0fc90 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-e9019c40-9cf9-48b0-949a-4afb70468647-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:07 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6bc08533-506e-4cbd-a727-6a31c9e0fc90 tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "cinder-quobyte-e9019c40-9cf9-48b0-949a-4afb70468647" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:08 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6bc08533-506e-4cbd-a727-6a31c9e0fc90 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-quobyte-e9019c40-9cf9-48b0-949a-4afb70468647" acquired by "delete_volume" :: waited 0.022s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:08 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8a1cb1-af78-4840-bdf3-3c4c755cb30c]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6bc08533-506e-4cbd-a727-6a31c9e0fc90 tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:08 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647 Sep 06 08:24:08 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:08 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb 1073741824" returned: 0 in 0.714s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:08 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb Sep 06 08:24:08 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:08 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6bc08533-506e-4cbd-a727-6a31c9e0fc90 tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647" returned: 0 in 0.580s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6bc08533-506e-4cbd-a727-6a31c9e0fc90 tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:08 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647 Sep 06 08:24:08 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:08 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb" returned: 0 in 0.418s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:08 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:24:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc5f145d-4ddd-4727-a0f7-0467aafc38a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f05801fc-7dde-4e02-a7dd-340472f175fb', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654fa7da-b1de-4375-8cac-97d53bf9667a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:08 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Volume volume-f05801fc-7dde-4e02-a7dd-340472f175fb (f05801fc-7dde-4e02-a7dd-340472f175fb): created successfully Sep 06 08:24:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654fa7da-b1de-4375-8cac-97d53bf9667a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:08 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Flow 'volume_create_manager' (89352b1b-06b7-48cb-bb5c-c00af660a468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:08 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-0636680a-5a7a-47c1-97f8-8a3a50990cf6 tempest-ProjectMemberTests-219511464 None] Created volume successfully. Sep 06 08:24:08 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6bc08533-506e-4cbd-a727-6a31c9e0fc90 tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-e9019c40-9cf9-48b0-949a-4afb70468647" returned: 0 in 0.328s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:08 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6bc08533-506e-4cbd-a727-6a31c9e0fc90 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-quobyte-e9019c40-9cf9-48b0-949a-4afb70468647" released by "delete_volume" :: held 0.976s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:09 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-6bc08533-506e-4cbd-a727-6a31c9e0fc90 tempest-CreateVolumesFromSnapshotTest-556812329 None] Created reservations ['0bb603ba-5a51-49b6-a0ad-fe324b4a8b63', 'af76794b-c529-48dc-9d89-44136a0a2331', '6e52be69-8360-4467-86dc-70f0519639a5', 'fbf7a285-3b06-482b-867e-9aa86ca86915'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6bc08533-506e-4cbd-a727-6a31c9e0fc90 tempest-CreateVolumesFromSnapshotTest-556812329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6bc08533-506e-4cbd-a727-6a31c9e0fc90 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:09 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6bc08533-506e-4cbd-a727-6a31c9e0fc90 tempest-CreateVolumesFromSnapshotTest-556812329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:09 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6bc08533-506e-4cbd-a727-6a31c9e0fc90 tempest-CreateVolumesFromSnapshotTest-556812329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6bc08533-506e-4cbd-a727-6a31c9e0fc90 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6bc08533-506e-4cbd-a727-6a31c9e0fc90 tempest-CreateVolumesFromSnapshotTest-556812329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:09 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:24:09 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:09 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6bc08533-506e-4cbd-a727-6a31c9e0fc90 tempest-CreateVolumesFromSnapshotTest-556812329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.297s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:09 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6bc08533-506e-4cbd-a727-6a31c9e0fc90 tempest-CreateVolumesFromSnapshotTest-556812329 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:24:09 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-6bc08533-506e-4cbd-a727-6a31c9e0fc90 tempest-CreateVolumesFromSnapshotTest-556812329 None] Deleted volume successfully. Sep 06 08:24:09 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6bc08533-506e-4cbd-a727-6a31c9e0fc90 tempest-CreateVolumesFromSnapshotTest-556812329 None] Lock "cinder-e9019c40-9cf9-48b0-949a-4afb70468647-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-01e63df5-bee8-4f10-b0a3-a5430b354b76 tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-01e63df5-bee8-4f10-b0a3-a5430b354b76 tempest-ProjectMemberTests-219511464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:09 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-01e63df5-bee8-4f10-b0a3-a5430b354b76 tempest-ProjectMemberTests-219511464 None] Creating offline snapshot 9fdae75f-dcc8-4d11-b8e9-251b56d134ba of volume f05801fc-7dde-4e02-a7dd-340472f175fb {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:24:09 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[96703e5f-5a34-4211-b8db-6303b1ebfc85]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01e63df5-bee8-4f10-b0a3-a5430b354b76 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:09 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb Sep 06 08:24:09 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:10 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01e63df5-bee8-4f10-b0a3-a5430b354b76 tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb" returned: 0 in 0.484s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01e63df5-bee8-4f10-b0a3-a5430b354b76 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.9fdae75f-dcc8-4d11-b8e9-251b56d134ba 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:10 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.9fdae75f-dcc8-4d11-b8e9-251b56d134ba 1G Sep 06 08:24:10 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:10 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01e63df5-bee8-4f10-b0a3-a5430b354b76 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.9fdae75f-dcc8-4d11-b8e9-251b56d134ba 1G" returned: 0 in 0.618s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01e63df5-bee8-4f10-b0a3-a5430b354b76 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f05801fc-7dde-4e02-a7dd-340472f175fb -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.9fdae75f-dcc8-4d11-b8e9-251b56d134ba {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:10 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f05801fc-7dde-4e02-a7dd-340472f175fb -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.9fdae75f-dcc8-4d11-b8e9-251b56d134ba Sep 06 08:24:10 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:11 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01e63df5-bee8-4f10-b0a3-a5430b354b76 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f05801fc-7dde-4e02-a7dd-340472f175fb -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.9fdae75f-dcc8-4d11-b8e9-251b56d134ba" returned: 0 in 0.464s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:11 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-01e63df5-bee8-4f10-b0a3-a5430b354b76 tempest-ProjectMemberTests-219511464 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.9fdae75f-dcc8-4d11-b8e9-251b56d134ba is being set with open permissions: ugo+rw Sep 06 08:24:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01e63df5-bee8-4f10-b0a3-a5430b354b76 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.9fdae75f-dcc8-4d11-b8e9-251b56d134ba {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:11 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.9fdae75f-dcc8-4d11-b8e9-251b56d134ba Sep 06 08:24:11 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:11 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01e63df5-bee8-4f10-b0a3-a5430b354b76 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.9fdae75f-dcc8-4d11-b8e9-251b56d134ba" returned: 0 in 0.366s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01e63df5-bee8-4f10-b0a3-a5430b354b76 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:11 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.info Sep 06 08:24:11 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:12 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01e63df5-bee8-4f10-b0a3-a5430b354b76 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.info" returned: 0 in 0.336s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:12 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-01e63df5-bee8-4f10-b0a3-a5430b354b76 tempest-ProjectMemberTests-219511464 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.info is being set with open permissions: ugo+rw Sep 06 08:24:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01e63df5-bee8-4f10-b0a3-a5430b354b76 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:12 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.info Sep 06 08:24:12 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:12 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-01e63df5-bee8-4f10-b0a3-a5430b354b76 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.info" returned: 0 in 0.409s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-01e63df5-bee8-4f10-b0a3-a5430b354b76 tempest-ProjectMemberTests-219511464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.804s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:12 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-01e63df5-bee8-4f10-b0a3-a5430b354b76 tempest-ProjectMemberTests-219511464 None] Create snapshot completed successfully Sep 06 08:24:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4be82a29-2d65-41cd-b8a2-e11b904ec7a1 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-9fdae75f-dcc8-4d11-b8e9-251b56d134ba-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4be82a29-2d65-41cd-b8a2-e11b904ec7a1 tempest-ProjectMemberTests-219511464 None] Lock "cinder-9fdae75f-dcc8-4d11-b8e9-251b56d134ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4be82a29-2d65-41cd-b8a2-e11b904ec7a1 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-f05801fc-7dde-4e02-a7dd-340472f175fb" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4be82a29-2d65-41cd-b8a2-e11b904ec7a1 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-f05801fc-7dde-4e02-a7dd-340472f175fb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4be82a29-2d65-41cd-b8a2-e11b904ec7a1 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-9fdae75f-dcc8-4d11-b8e9-251b56d134ba" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4be82a29-2d65-41cd-b8a2-e11b904ec7a1 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-9fdae75f-dcc8-4d11-b8e9-251b56d134ba" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-4be82a29-2d65-41cd-b8a2-e11b904ec7a1 tempest-ProjectMemberTests-219511464 None] Deleting offline snapshot 9fdae75f-dcc8-4d11-b8e9-251b56d134ba of volume f05801fc-7dde-4e02-a7dd-340472f175fb {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:24:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-4be82a29-2d65-41cd-b8a2-e11b904ec7a1 tempest-ProjectMemberTests-219511464 None] snapshot_file for this snap is: volume-f05801fc-7dde-4e02-a7dd-340472f175fb.9fdae75f-dcc8-4d11-b8e9-251b56d134ba {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:24:13 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d99aa22-c09e-4f88-9186-2ea6380a3016]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4be82a29-2d65-41cd-b8a2-e11b904ec7a1 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.9fdae75f-dcc8-4d11-b8e9-251b56d134ba {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:13 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.9fdae75f-dcc8-4d11-b8e9-251b56d134ba Sep 06 08:24:13 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:13 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4be82a29-2d65-41cd-b8a2-e11b904ec7a1 tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.9fdae75f-dcc8-4d11-b8e9-251b56d134ba" returned: 0 in 0.727s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-4be82a29-2d65-41cd-b8a2-e11b904ec7a1 tempest-ProjectMemberTests-219511464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f05801fc-7dde-4e02-a7dd-340472f175fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:24:13 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[92305fdc-6021-49ee-9f53-f849d55b97e9]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4be82a29-2d65-41cd-b8a2-e11b904ec7a1 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:14 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb Sep 06 08:24:14 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:14 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4be82a29-2d65-41cd-b8a2-e11b904ec7a1 tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb" returned: 0 in 0.549s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4be82a29-2d65-41cd-b8a2-e11b904ec7a1 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.9fdae75f-dcc8-4d11-b8e9-251b56d134ba {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:14 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.9fdae75f-dcc8-4d11-b8e9-251b56d134ba Sep 06 08:24:14 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Flow 'volume_create_manager' (9c9ca4d3-a438-4453-a1df-1beae50c7f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1aa946d-48cc-4df9-9da4-372da2686a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1aa946d-48cc-4df9-9da4-372da2686a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1729026742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c4cec6c-3701-46ce-905f-6116bfadc32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c5f28a6408c42f3b3f158832ddc125e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:15Z,use_quota=True,user_id='33c1813c959a4faf88b08697fb1e347d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1287a391-e218-4978-a6a4-3ff6c6e13fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1287a391-e218-4978-a6a4-3ff6c6e13fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f7f1ea-34b2-4478-a374-4187e67ef63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f7f1ea-34b2-4478-a374-4187e67ef63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c4cec6c-3701-46ce-905f-6116bfadc32d', 'volume_name': 'volume-4c4cec6c-3701-46ce-905f-6116bfadc32d', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e92eebe7-c18c-4731-b1c1-38bbc0725db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e92eebe7-c18c-4731-b1c1-38bbc0725db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:14 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c432401-a1cf-4caf-a849-b14b711ff5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:14 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Volume 4c4cec6c-3701-46ce-905f-6116bfadc32d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c4cec6c-3701-46ce-905f-6116bfadc32d', 'volume_size': 1} Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1729026742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c4cec6c-3701-46ce-905f-6116bfadc32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c5f28a6408c42f3b3f158832ddc125e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:15Z,use_quota=True,user_id='33c1813c959a4faf88b08697fb1e347d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Creating volume 4c4cec6c-3701-46ce-905f-6116bfadc32d {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:24:14 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4c4cec6c-3701-46ce-905f-6116bfadc32d 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4be82a29-2d65-41cd-b8a2-e11b904ec7a1 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.9fdae75f-dcc8-4d11-b8e9-251b56d134ba" returned: 0 in 0.478s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4be82a29-2d65-41cd-b8a2-e11b904ec7a1 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.9fdae75f-dcc8-4d11-b8e9-251b56d134ba {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:15 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4c4cec6c-3701-46ce-905f-6116bfadc32d 1073741824 Sep 06 08:24:15 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:15 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.9fdae75f-dcc8-4d11-b8e9-251b56d134ba Sep 06 08:24:15 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:15 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-4be82a29-2d65-41cd-b8a2-e11b904ec7a1 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb.9fdae75f-dcc8-4d11-b8e9-251b56d134ba" returned: 0 in 0.420s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:15 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4be82a29-2d65-41cd-b8a2-e11b904ec7a1 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-9fdae75f-dcc8-4d11-b8e9-251b56d134ba" released by "_delete_snapshot" :: held 2.312s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:15 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4be82a29-2d65-41cd-b8a2-e11b904ec7a1 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-f05801fc-7dde-4e02-a7dd-340472f175fb" released by "delete_snapshot" :: held 2.345s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:15 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-4be82a29-2d65-41cd-b8a2-e11b904ec7a1 tempest-ProjectMemberTests-219511464 None] Created reservations ['e437c524-61d1-47b6-acb9-67c7ea652e3d', '40463e66-572e-4331-aa90-35cf0680ec48', '9fceb234-d974-42ee-9a53-b9764478173f', 'd3f176a7-9015-47e8-8114-5566c1f5a6d0'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:15 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4c4cec6c-3701-46ce-905f-6116bfadc32d 1073741824" returned: 0 in 0.583s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4c4cec6c-3701-46ce-905f-6116bfadc32d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:15 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-4be82a29-2d65-41cd-b8a2-e11b904ec7a1 tempest-ProjectMemberTests-219511464 None] Delete snapshot completed successfully. Sep 06 08:24:15 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4c4cec6c-3701-46ce-905f-6116bfadc32d Sep 06 08:24:15 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:15 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-4be82a29-2d65-41cd-b8a2-e11b904ec7a1 tempest-ProjectMemberTests-219511464 None] Lock "cinder-9fdae75f-dcc8-4d11-b8e9-251b56d134ba-delete_snapshot" released by "delete_snapshot" :: held 2.561s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:15 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4c4cec6c-3701-46ce-905f-6116bfadc32d" returned: 0 in 0.325s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:15 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:24:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c432401-a1cf-4caf-a849-b14b711ff5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c4cec6c-3701-46ce-905f-6116bfadc32d', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f272567f-6857-42f5-bf06-40f4cff0a280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:15 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Volume volume-4c4cec6c-3701-46ce-905f-6116bfadc32d (4c4cec6c-3701-46ce-905f-6116bfadc32d): created successfully Sep 06 08:24:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f272567f-6857-42f5-bf06-40f4cff0a280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:15 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Flow 'volume_create_manager' (9c9ca4d3-a438-4453-a1df-1beae50c7f87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:15 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-6e011fa2-5534-4292-81e4-d1afc51a0d3d tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Created volume successfully. Sep 06 08:24:16 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f171ece5-9287-4c7c-80c1-8f863a30622d tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-f05801fc-7dde-4e02-a7dd-340472f175fb-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:16 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f171ece5-9287-4c7c-80c1-8f863a30622d tempest-ProjectMemberTests-219511464 None] Lock "cinder-f05801fc-7dde-4e02-a7dd-340472f175fb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:16 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f171ece5-9287-4c7c-80c1-8f863a30622d tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-f05801fc-7dde-4e02-a7dd-340472f175fb" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:16 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f171ece5-9287-4c7c-80c1-8f863a30622d tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-f05801fc-7dde-4e02-a7dd-340472f175fb" acquired by "delete_volume" :: waited 0.019s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:16 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[944b8b92-db46-4d34-9265-ccdd9e7fd617]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f171ece5-9287-4c7c-80c1-8f863a30622d tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:16 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb Sep 06 08:24:16 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:16 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f171ece5-9287-4c7c-80c1-8f863a30622d tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb" returned: 0 in 0.479s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f171ece5-9287-4c7c-80c1-8f863a30622d tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:16 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb Sep 06 08:24:17 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:17 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f171ece5-9287-4c7c-80c1-8f863a30622d tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f05801fc-7dde-4e02-a7dd-340472f175fb" returned: 0 in 0.403s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f171ece5-9287-4c7c-80c1-8f863a30622d tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-f05801fc-7dde-4e02-a7dd-340472f175fb" released by "delete_volume" :: held 0.979s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Flow 'volume_create_manager' (158dee77-c963-4ee2-bf05-f73f3c4993be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1252a36-dcf6-4b29-85b4-93f373884324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1252a36-dcf6-4b29-85b4-93f373884324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2061122341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=750deb6b-3ebf-4519-8909-f1c1b4f8b729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c5f28a6408c42f3b3f158832ddc125e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:17Z,use_quota=True,user_id='33c1813c959a4faf88b08697fb1e347d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f2fce0-3145-45c1-a34c-f0f0eb2b4bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f2fce0-3145-45c1-a34c-f0f0eb2b4bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08110981-1f5e-401e-bd5f-aee7add8b89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08110981-1f5e-401e-bd5f-aee7add8b89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '750deb6b-3ebf-4519-8909-f1c1b4f8b729', 'volume_name': 'volume-750deb6b-3ebf-4519-8909-f1c1b4f8b729', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c497bc25-f406-4be0-a1d9-6d2da746d2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c497bc25-f406-4be0-a1d9-6d2da746d2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c05589d-f380-4f9e-82a6-84637750216f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:17 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Volume 750deb6b-3ebf-4519-8909-f1c1b4f8b729: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-750deb6b-3ebf-4519-8909-f1c1b4f8b729', 'volume_size': 1} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2061122341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=750deb6b-3ebf-4519-8909-f1c1b4f8b729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c5f28a6408c42f3b3f158832ddc125e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:17Z,use_quota=True,user_id='33c1813c959a4faf88b08697fb1e347d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Creating volume 750deb6b-3ebf-4519-8909-f1c1b4f8b729 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:24:17 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-750deb6b-3ebf-4519-8909-f1c1b4f8b729 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-f171ece5-9287-4c7c-80c1-8f863a30622d tempest-ProjectMemberTests-219511464 None] Created reservations ['86eda4f9-c6a8-4eaa-8420-399d387c3cba', 'e86d31d2-9e1d-4e43-a0e4-589e3a5240f7', '24ae8ec6-7730-4563-8a15-103bb03c7c0e', 'd262d3cc-ecf9-495c-92d2-d246794e8035'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:17 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-750deb6b-3ebf-4519-8909-f1c1b4f8b729 1073741824 Sep 06 08:24:17 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f171ece5-9287-4c7c-80c1-8f863a30622d tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f171ece5-9287-4c7c-80c1-8f863a30622d tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f171ece5-9287-4c7c-80c1-8f863a30622d tempest-ProjectMemberTests-219511464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f171ece5-9287-4c7c-80c1-8f863a30622d tempest-ProjectMemberTests-219511464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f171ece5-9287-4c7c-80c1-8f863a30622d tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f171ece5-9287-4c7c-80c1-8f863a30622d tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:17 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:24:17 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:18 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f171ece5-9287-4c7c-80c1-8f863a30622d tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.300s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-f171ece5-9287-4c7c-80c1-8f863a30622d tempest-ProjectMemberTests-219511464 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:24:18 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f171ece5-9287-4c7c-80c1-8f863a30622d tempest-ProjectMemberTests-219511464 None] Deleted volume successfully. Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f171ece5-9287-4c7c-80c1-8f863a30622d tempest-ProjectMemberTests-219511464 None] Lock "cinder-f05801fc-7dde-4e02-a7dd-340472f175fb-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Flow 'volume_create_manager' (5c5787f9-8358-44e8-b971-0e2e712f9a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af9d76bf-5644-459c-9026-c578686c6c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af9d76bf-5644-459c-9026-c578686c6c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1790515346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ecf2d21-5ab2-4a69-8206-3494b5a412b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c5f28a6408c42f3b3f158832ddc125e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:18Z,use_quota=True,user_id='33c1813c959a4faf88b08697fb1e347d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b5e2a58-0736-4f59-8ac2-cd80e85581e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b5e2a58-0736-4f59-8ac2-cd80e85581e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53209db3-ef1d-4c60-9cd7-93f5aefacf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53209db3-ef1d-4c60-9cd7-93f5aefacf6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ecf2d21-5ab2-4a69-8206-3494b5a412b1', 'volume_name': 'volume-7ecf2d21-5ab2-4a69-8206-3494b5a412b1', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0f78ce-8cbf-4890-b9ea-74ba99db070b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0f78ce-8cbf-4890-b9ea-74ba99db070b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b372d654-b071-4e9d-b24b-06f99dc02dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:18 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Volume 7ecf2d21-5ab2-4a69-8206-3494b5a412b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ecf2d21-5ab2-4a69-8206-3494b5a412b1', 'volume_size': 1} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:18 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-750deb6b-3ebf-4519-8909-f1c1b4f8b729 1073741824" returned: 0 in 0.791s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-750deb6b-3ebf-4519-8909-f1c1b4f8b729 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:18 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-750deb6b-3ebf-4519-8909-f1c1b4f8b729 Sep 06 08:24:18 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Flow 'volume_create_manager' (9584068c-33ac-4a64-8619-47099e49d310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3118c1-4c93-4031-9a14-4cbfbf96f88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3118c1-4c93-4031-9a14-4cbfbf96f88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1626971095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c109f8e-77fe-4b1a-8ef6-288a46514f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c5f28a6408c42f3b3f158832ddc125e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:19Z,use_quota=True,user_id='33c1813c959a4faf88b08697fb1e347d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff24fe0-34e6-48ca-9847-c350a8ebbe0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff24fe0-34e6-48ca-9847-c350a8ebbe0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f8b4d2-9eef-4997-83ca-b35db6f8ff16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f8b4d2-9eef-4997-83ca-b35db6f8ff16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c109f8e-77fe-4b1a-8ef6-288a46514f97', 'volume_name': 'volume-4c109f8e-77fe-4b1a-8ef6-288a46514f97', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28aff62-cb62-47d7-b856-e8cfab017d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28aff62-cb62-47d7-b856-e8cfab017d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6053753-88c5-4471-b3be-bff2dc72edb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:18 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Volume 4c109f8e-77fe-4b1a-8ef6-288a46514f97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c109f8e-77fe-4b1a-8ef6-288a46514f97', 'volume_size': 1} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:18 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-750deb6b-3ebf-4519-8909-f1c1b4f8b729" returned: 0 in 0.467s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.657s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1790515346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ecf2d21-5ab2-4a69-8206-3494b5a412b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c5f28a6408c42f3b3f158832ddc125e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:18Z,use_quota=True,user_id='33c1813c959a4faf88b08697fb1e347d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Creating volume 7ecf2d21-5ab2-4a69-8206-3494b5a412b1 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:24:18 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:24:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7ecf2d21-5ab2-4a69-8206-3494b5a412b1 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c05589d-f380-4f9e-82a6-84637750216f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-750deb6b-3ebf-4519-8909-f1c1b4f8b729', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:19 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7ecf2d21-5ab2-4a69-8206-3494b5a412b1 1073741824 Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b8b3b1-589f-4530-984e-5b42e7a47b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:19 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:19 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Volume volume-750deb6b-3ebf-4519-8909-f1c1b4f8b729 (750deb6b-3ebf-4519-8909-f1c1b4f8b729): created successfully Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b8b3b1-589f-4530-984e-5b42e7a47b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Flow 'volume_create_manager' (158dee77-c963-4ee2-bf05-f73f3c4993be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:19 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-9306d68d-7d6e-428b-a6ba-a11d3eaa1661 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Created volume successfully. Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:24:19 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Flow 'volume_create_manager' (3d2d902a-c2e5-4c1c-a9c7-eeb1080fb9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c247baa-2d0c-49e8-b627-045c18a372e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7ecf2d21-5ab2-4a69-8206-3494b5a412b1 1073741824" returned: 0 in 0.806s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c247baa-2d0c-49e8-b627-045c18a372e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1634034488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4707447-c438-4085-b272-58a096229e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c5f28a6408c42f3b3f158832ddc125e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:20Z,use_quota=True,user_id='33c1813c959a4faf88b08697fb1e347d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4b7d84-ff41-491e-9397-3b08936ce04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4b7d84-ff41-491e-9397-3b08936ce04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5726ba5-4981-44bb-8df1-4b9335a53245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5726ba5-4981-44bb-8df1-4b9335a53245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4707447-c438-4085-b272-58a096229e3f', 'volume_name': 'volume-a4707447-c438-4085-b272-58a096229e3f', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6ef65a-6463-42a3-b365-75c49d2e4bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6ef65a-6463-42a3-b365-75c49d2e4bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f1088e-9058-4f95-aa8f-6e793c2cb923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:19 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Volume a4707447-c438-4085-b272-58a096229e3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4707447-c438-4085-b272-58a096229e3f', 'volume_size': 1} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Flow 'volume_create_manager' (f51205ce-3316-4251-8eb9-cb4a268fc9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb80974-830e-4d2a-99f3-7dcb576a266e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb80974-830e-4d2a-99f3-7dcb576a266e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-798137544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad03189-d941-4bea-9cb6-11970f8d533d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57ff192bd0a74a27be0be1f1201231cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:20Z,use_quota=True,user_id='0f50a8b862534662bb877ccafabde4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ea763b6-6d07-459d-bbc8-c62aaa422b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ea763b6-6d07-459d-bbc8-c62aaa422b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965f0849-e69f-44da-b3f0-b8f0aab7bdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965f0849-e69f-44da-b3f0-b8f0aab7bdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fad03189-d941-4bea-9cb6-11970f8d533d', 'volume_name': 'volume-fad03189-d941-4bea-9cb6-11970f8d533d', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c5e6f9-fa22-49a7-8fd0-e9db958b300c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c5e6f9-fa22-49a7-8fd0-e9db958b300c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6de0cd4-7c64-4c37-9a02-aefb817d7e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:19 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Volume fad03189-d941-4bea-9cb6-11970f8d533d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fad03189-d941-4bea-9cb6-11970f8d533d', 'volume_size': 1} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7ecf2d21-5ab2-4a69-8206-3494b5a412b1 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:20 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7ecf2d21-5ab2-4a69-8206-3494b5a412b1 Sep 06 08:24:20 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Flow 'volume_create_manager' (03e45398-99c0-4fc1-829d-1eb0eb2f3774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16154f5-4d54-4959-958e-bc6a480a5d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16154f5-4d54-4959-958e-bc6a480a5d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1043472259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b0bc0e-5971-4465-9f68-0dd4a884e488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c5f28a6408c42f3b3f158832ddc125e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:20Z,use_quota=True,user_id='33c1813c959a4faf88b08697fb1e347d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45e1445-6f84-4e0a-967b-2f96d5cd6865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45e1445-6f84-4e0a-967b-2f96d5cd6865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2614e4d-f027-4b66-9bbc-4be420ce2873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2614e4d-f027-4b66-9bbc-4be420ce2873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84b0bc0e-5971-4465-9f68-0dd4a884e488', 'volume_name': 'volume-84b0bc0e-5971-4465-9f68-0dd4a884e488', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a166ced-c015-4912-8da4-441795a4acfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a166ced-c015-4912-8da4-441795a4acfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc8810a-9424-4783-97af-48b17d9d2947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:20 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Volume 84b0bc0e-5971-4465-9f68-0dd4a884e488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84b0bc0e-5971-4465-9f68-0dd4a884e488', 'volume_size': 1} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:20 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7ecf2d21-5ab2-4a69-8206-3494b5a412b1" returned: 0 in 0.277s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.359s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1626971095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c109f8e-77fe-4b1a-8ef6-288a46514f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c5f28a6408c42f3b3f158832ddc125e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:19Z,use_quota=True,user_id='33c1813c959a4faf88b08697fb1e347d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Creating volume 4c109f8e-77fe-4b1a-8ef6-288a46514f97 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:24:20 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4c109f8e-77fe-4b1a-8ef6-288a46514f97 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b372d654-b071-4e9d-b24b-06f99dc02dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ecf2d21-5ab2-4a69-8206-3494b5a412b1', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18ae279-5846-4896-8274-6913e11414e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:20 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4c109f8e-77fe-4b1a-8ef6-288a46514f97 1073741824 Sep 06 08:24:20 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:20 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Volume volume-7ecf2d21-5ab2-4a69-8206-3494b5a412b1 (7ecf2d21-5ab2-4a69-8206-3494b5a412b1): created successfully Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18ae279-5846-4896-8274-6913e11414e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Flow 'volume_create_manager' (5c5787f9-8358-44e8-b971-0e2e712f9a0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:20 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e79d356e-3c40-4b20-bd4f-4e5a051b7afe tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Created volume successfully. Sep 06 08:24:20 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4c109f8e-77fe-4b1a-8ef6-288a46514f97 1073741824" returned: 0 in 0.498s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4c109f8e-77fe-4b1a-8ef6-288a46514f97 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:20 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4c109f8e-77fe-4b1a-8ef6-288a46514f97 Sep 06 08:24:20 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:21 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4c109f8e-77fe-4b1a-8ef6-288a46514f97" returned: 0 in 0.447s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:24:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.432s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1634034488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4707447-c438-4085-b272-58a096229e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c5f28a6408c42f3b3f158832ddc125e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:20Z,use_quota=True,user_id='33c1813c959a4faf88b08697fb1e347d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:24:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Creating volume a4707447-c438-4085-b272-58a096229e3f {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:24:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:24:21 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:24:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a4707447-c438-4085-b272-58a096229e3f 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6053753-88c5-4471-b3be-bff2dc72edb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c109f8e-77fe-4b1a-8ef6-288a46514f97', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b9dea8-15f3-4ef1-9fae-2e6b71e71eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:21 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a4707447-c438-4085-b272-58a096229e3f 1073741824 Sep 06 08:24:21 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:21 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Volume volume-4c109f8e-77fe-4b1a-8ef6-288a46514f97 (4c109f8e-77fe-4b1a-8ef6-288a46514f97): created successfully Sep 06 08:24:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b9dea8-15f3-4ef1-9fae-2e6b71e71eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Flow 'volume_create_manager' (9584068c-33ac-4a64-8619-47099e49d310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:21 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-add64ce4-8f30-4616-a64c-2d13a67b7e75 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Created volume successfully. Sep 06 08:24:21 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a4707447-c438-4085-b272-58a096229e3f 1073741824" returned: 0 in 0.539s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a4707447-c438-4085-b272-58a096229e3f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:21 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a4707447-c438-4085-b272-58a096229e3f Sep 06 08:24:21 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:22 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a4707447-c438-4085-b272-58a096229e3f" returned: 0 in 0.372s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:22 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:24:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.326s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:22 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-798137544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad03189-d941-4bea-9cb6-11970f8d533d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57ff192bd0a74a27be0be1f1201231cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:20Z,use_quota=True,user_id='0f50a8b862534662bb877ccafabde4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:24:22 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Creating volume fad03189-d941-4bea-9cb6-11970f8d533d {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:24:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:22 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:22 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:22 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:24:22 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:24:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f1088e-9058-4f95-aa8f-6e793c2cb923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4707447-c438-4085-b272-58a096229e3f', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:22 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d 1073741824 Sep 06 08:24:22 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfaf1cb4-6500-42e9-826d-08b605721174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:22 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Volume volume-a4707447-c438-4085-b272-58a096229e3f (a4707447-c438-4085-b272-58a096229e3f): created successfully Sep 06 08:24:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfaf1cb4-6500-42e9-826d-08b605721174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:22 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Flow 'volume_create_manager' (3d2d902a-c2e5-4c1c-a9c7-eeb1080fb9b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:22 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-8ae9f65c-5d12-4d9a-814c-f99c941d13db tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Created volume successfully. Sep 06 08:24:22 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d 1073741824" returned: 0 in 0.602s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:22 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d Sep 06 08:24:22 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:23 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d" returned: 0 in 0.291s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:24:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.092s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1043472259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b0bc0e-5971-4465-9f68-0dd4a884e488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c5f28a6408c42f3b3f158832ddc125e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:20Z,use_quota=True,user_id='33c1813c959a4faf88b08697fb1e347d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:24:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Creating volume 84b0bc0e-5971-4465-9f68-0dd4a884e488 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:24:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:23 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:24:23 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:24:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-84b0bc0e-5971-4465-9f68-0dd4a884e488 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6de0cd4-7c64-4c37-9a02-aefb817d7e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fad03189-d941-4bea-9cb6-11970f8d533d', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (862d8c26-28f9-4581-92e1-39bc4c8aa59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:23 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-84b0bc0e-5971-4465-9f68-0dd4a884e488 1073741824 Sep 06 08:24:23 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:23 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Volume volume-fad03189-d941-4bea-9cb6-11970f8d533d (fad03189-d941-4bea-9cb6-11970f8d533d): created successfully Sep 06 08:24:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (862d8c26-28f9-4581-92e1-39bc4c8aa59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:23 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Flow 'volume_create_manager' (f51205ce-3316-4251-8eb9-cb4a268fc9a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:23 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f72e751c-0cb2-45b3-9d91-3243dd5ed8d7 tempest-ProjectMemberTests-219511464 None] Created volume successfully. Sep 06 08:24:23 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-84b0bc0e-5971-4465-9f68-0dd4a884e488 1073741824" returned: 0 in 0.596s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-84b0bc0e-5971-4465-9f68-0dd4a884e488 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:23 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-84b0bc0e-5971-4465-9f68-0dd4a884e488 Sep 06 08:24:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9290cf6b-1f52-47d2-98bc-0cf68ff743ef tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:23 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:24 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-84b0bc0e-5971-4465-9f68-0dd4a884e488" returned: 0 in 0.262s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:24:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9290cf6b-1f52-47d2-98bc-0cf68ff743ef tempest-ProjectMemberTests-219511464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.231s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc8810a-9424-4783-97af-48b17d9d2947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84b0bc0e-5971-4465-9f68-0dd4a884e488', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f18bd7bc-543b-43cf-a8c1-41ad777e7846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-9290cf6b-1f52-47d2-98bc-0cf68ff743ef tempest-ProjectMemberTests-219511464 None] Creating offline snapshot ce2f62c6-790c-43e0-ac2d-b4f377f0a41e of volume fad03189-d941-4bea-9cb6-11970f8d533d {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:24:24 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Volume volume-84b0bc0e-5971-4465-9f68-0dd4a884e488 (84b0bc0e-5971-4465-9f68-0dd4a884e488): created successfully Sep 06 08:24:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f18bd7bc-543b-43cf-a8c1-41ad777e7846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:24 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Flow 'volume_create_manager' (03e45398-99c0-4fc1-829d-1eb0eb2f3774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:24 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[21eb379f-8c33-4605-80fe-26912e792ebc]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9290cf6b-1f52-47d2-98bc-0cf68ff743ef tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:24 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-615a86f0-2bf6-48e7-892b-5ccca52257ce tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Created volume successfully. Sep 06 08:24:24 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d Sep 06 08:24:24 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:24 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9290cf6b-1f52-47d2-98bc-0cf68ff743ef tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d" returned: 0 in 0.392s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9290cf6b-1f52-47d2-98bc-0cf68ff743ef tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.ce2f62c6-790c-43e0-ac2d-b4f377f0a41e 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:24 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.ce2f62c6-790c-43e0-ac2d-b4f377f0a41e 1G Sep 06 08:24:24 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:24 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-53b53d1a-8c02-4b40-8583-d84347d67312 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "cinder-84b0bc0e-5971-4465-9f68-0dd4a884e488-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:24 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-53b53d1a-8c02-4b40-8583-d84347d67312 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "cinder-84b0bc0e-5971-4465-9f68-0dd4a884e488-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:24 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-53b53d1a-8c02-4b40-8583-d84347d67312 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "cinder-quobyte-84b0bc0e-5971-4465-9f68-0dd4a884e488" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:24 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-53b53d1a-8c02-4b40-8583-d84347d67312 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "cinder-quobyte-84b0bc0e-5971-4465-9f68-0dd4a884e488" acquired by "delete_volume" :: waited 0.019s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:24 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a454e5-f060-43ed-92a5-ae9cf52a19ee]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-53b53d1a-8c02-4b40-8583-d84347d67312 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-84b0bc0e-5971-4465-9f68-0dd4a884e488 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:24 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-84b0bc0e-5971-4465-9f68-0dd4a884e488 Sep 06 08:24:24 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:25 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9290cf6b-1f52-47d2-98bc-0cf68ff743ef tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.ce2f62c6-790c-43e0-ac2d-b4f377f0a41e 1G" returned: 0 in 0.491s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9290cf6b-1f52-47d2-98bc-0cf68ff743ef tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fad03189-d941-4bea-9cb6-11970f8d533d -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.ce2f62c6-790c-43e0-ac2d-b4f377f0a41e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:25 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fad03189-d941-4bea-9cb6-11970f8d533d -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.ce2f62c6-790c-43e0-ac2d-b4f377f0a41e Sep 06 08:24:25 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:25 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-53b53d1a-8c02-4b40-8583-d84347d67312 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-84b0bc0e-5971-4465-9f68-0dd4a884e488" returned: 0 in 0.478s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-53b53d1a-8c02-4b40-8583-d84347d67312 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-84b0bc0e-5971-4465-9f68-0dd4a884e488 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:25 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-84b0bc0e-5971-4465-9f68-0dd4a884e488 Sep 06 08:24:25 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:25 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9290cf6b-1f52-47d2-98bc-0cf68ff743ef tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fad03189-d941-4bea-9cb6-11970f8d533d -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.ce2f62c6-790c-43e0-ac2d-b4f377f0a41e" returned: 0 in 0.397s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:25 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-9290cf6b-1f52-47d2-98bc-0cf68ff743ef tempest-ProjectMemberTests-219511464 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.ce2f62c6-790c-43e0-ac2d-b4f377f0a41e is being set with open permissions: ugo+rw Sep 06 08:24:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9290cf6b-1f52-47d2-98bc-0cf68ff743ef tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.ce2f62c6-790c-43e0-ac2d-b4f377f0a41e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:25 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.ce2f62c6-790c-43e0-ac2d-b4f377f0a41e Sep 06 08:24:25 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:25 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-53b53d1a-8c02-4b40-8583-d84347d67312 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-84b0bc0e-5971-4465-9f68-0dd4a884e488" returned: 0 in 0.263s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:25 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-53b53d1a-8c02-4b40-8583-d84347d67312 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "cinder-quobyte-84b0bc0e-5971-4465-9f68-0dd4a884e488" released by "delete_volume" :: held 0.788s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:25 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-53b53d1a-8c02-4b40-8583-d84347d67312 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Created reservations ['666098de-b9e4-44df-9f75-4a5b31279901', 'b1b22aa2-cd25-4968-bfac-03debb61318a', 'c311f293-9c6d-4ac9-b200-e6209c50f55c', '5408921c-057b-47ae-b5ee-0856203e0fb2'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-53b53d1a-8c02-4b40-8583-d84347d67312 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-53b53d1a-8c02-4b40-8583-d84347d67312 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:25 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-53b53d1a-8c02-4b40-8583-d84347d67312 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:25 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-53b53d1a-8c02-4b40-8583-d84347d67312 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-53b53d1a-8c02-4b40-8583-d84347d67312 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-53b53d1a-8c02-4b40-8583-d84347d67312 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:25 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:24:25 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:25 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9290cf6b-1f52-47d2-98bc-0cf68ff743ef tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.ce2f62c6-790c-43e0-ac2d-b4f377f0a41e" returned: 0 in 0.326s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9290cf6b-1f52-47d2-98bc-0cf68ff743ef tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:25 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.info Sep 06 08:24:25 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2d2d2b8d-2e03-4dd9-9d57-bfd0e1721424 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "cinder-a4707447-c438-4085-b272-58a096229e3f-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2d2d2b8d-2e03-4dd9-9d57-bfd0e1721424 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "cinder-a4707447-c438-4085-b272-58a096229e3f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2d2d2b8d-2e03-4dd9-9d57-bfd0e1721424 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "cinder-quobyte-a4707447-c438-4085-b272-58a096229e3f" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2d2d2b8d-2e03-4dd9-9d57-bfd0e1721424 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "cinder-quobyte-a4707447-c438-4085-b272-58a096229e3f" acquired by "delete_volume" :: waited 0.034s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:26 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-53b53d1a-8c02-4b40-8583-d84347d67312 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.424s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-53b53d1a-8c02-4b40-8583-d84347d67312 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:24:26 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-53b53d1a-8c02-4b40-8583-d84347d67312 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Deleted volume successfully. Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b73c80c-431b-4256-84f7-0c30078187ca]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2d2d2b8d-2e03-4dd9-9d57-bfd0e1721424 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a4707447-c438-4085-b272-58a096229e3f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-53b53d1a-8c02-4b40-8583-d84347d67312 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "cinder-84b0bc0e-5971-4465-9f68-0dd4a884e488-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:26 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9290cf6b-1f52-47d2-98bc-0cf68ff743ef tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.info" returned: 0 in 0.426s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:26 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-9290cf6b-1f52-47d2-98bc-0cf68ff743ef tempest-ProjectMemberTests-219511464 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.info is being set with open permissions: ugo+rw Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9290cf6b-1f52-47d2-98bc-0cf68ff743ef tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:26 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.info Sep 06 08:24:26 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:26 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a4707447-c438-4085-b272-58a096229e3f Sep 06 08:24:26 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:26 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-9290cf6b-1f52-47d2-98bc-0cf68ff743ef tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.info" returned: 0 in 0.349s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:26 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-9290cf6b-1f52-47d2-98bc-0cf68ff743ef tempest-ProjectMemberTests-219511464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.530s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2d2d2b8d-2e03-4dd9-9d57-bfd0e1721424 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a4707447-c438-4085-b272-58a096229e3f" returned: 0 in 0.500s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2d2d2b8d-2e03-4dd9-9d57-bfd0e1721424 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a4707447-c438-4085-b272-58a096229e3f {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:26 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a4707447-c438-4085-b272-58a096229e3f Sep 06 08:24:26 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:26 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-9290cf6b-1f52-47d2-98bc-0cf68ff743ef tempest-ProjectMemberTests-219511464 None] Create snapshot completed successfully Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Flow 'volume_create_manager' (1a764642-cef9-4bff-9995-a7d80922aaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66da05b-7ae4-4167-af26-5a19da8a3c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66da05b-7ae4-4167-af26-5a19da8a3c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1436580397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad9a42bc-938a-4152-b515-3f0900643e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2073adb0194c69b5bd65dfec383b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:27Z,use_quota=True,user_id='d8ea0c5f3fda4d1090f4e20d1ba6e195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2138d2c-a191-4e0a-a1be-26e2166dbb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2138d2c-a191-4e0a-a1be-26e2166dbb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eaa7bdb-7bfe-45fb-a5bb-c9c99932c7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eaa7bdb-7bfe-45fb-a5bb-c9c99932c7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad9a42bc-938a-4152-b515-3f0900643e66', 'volume_name': 'volume-ad9a42bc-938a-4152-b515-3f0900643e66', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (522200e7-4314-47ba-85be-673459cba81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (522200e7-4314-47ba-85be-673459cba81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (750fb406-89ba-4acd-9a4e-8c6bdc6228ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:26 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Volume ad9a42bc-938a-4152-b515-3f0900643e66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad9a42bc-938a-4152-b515-3f0900643e66', 'volume_size': 1} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1436580397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad9a42bc-938a-4152-b515-3f0900643e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2073adb0194c69b5bd65dfec383b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:27Z,use_quota=True,user_id='d8ea0c5f3fda4d1090f4e20d1ba6e195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Creating volume ad9a42bc-938a-4152-b515-3f0900643e66 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:24:26 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:24:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:26 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2d2d2b8d-2e03-4dd9-9d57-bfd0e1721424 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-a4707447-c438-4085-b272-58a096229e3f" returned: 0 in 0.280s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2d2d2b8d-2e03-4dd9-9d57-bfd0e1721424 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "cinder-quobyte-a4707447-c438-4085-b272-58a096229e3f" released by "delete_volume" :: held 0.854s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:27 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66 1073741824 Sep 06 08:24:27 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-2d2d2b8d-2e03-4dd9-9d57-bfd0e1721424 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Created reservations ['92d360de-3833-45c7-add4-48a7607764a5', '6d78015b-d14d-4924-b383-094354ed22c9', '42f5de5e-39f2-4cf7-85ef-23df372414c5', 'b3ca140f-e42d-4dc7-9258-953b671e30b9'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2d2d2b8d-2e03-4dd9-9d57-bfd0e1721424 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2d2d2b8d-2e03-4dd9-9d57-bfd0e1721424 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2d2d2b8d-2e03-4dd9-9d57-bfd0e1721424 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2d2d2b8d-2e03-4dd9-9d57-bfd0e1721424 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2d2d2b8d-2e03-4dd9-9d57-bfd0e1721424 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2d2d2b8d-2e03-4dd9-9d57-bfd0e1721424 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:27 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:24:27 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-853526bc-38d1-4018-ab3a-68ed23754f2f tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-ce2f62c6-790c-43e0-ac2d-b4f377f0a41e-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-853526bc-38d1-4018-ab3a-68ed23754f2f tempest-ProjectMemberTests-219511464 None] Lock "cinder-ce2f62c6-790c-43e0-ac2d-b4f377f0a41e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-853526bc-38d1-4018-ab3a-68ed23754f2f tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-fad03189-d941-4bea-9cb6-11970f8d533d" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-853526bc-38d1-4018-ab3a-68ed23754f2f tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-fad03189-d941-4bea-9cb6-11970f8d533d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-853526bc-38d1-4018-ab3a-68ed23754f2f tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-ce2f62c6-790c-43e0-ac2d-b4f377f0a41e" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-416534dd-c16e-45a5-8545-d3ed0fae3cf9 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "cinder-4c109f8e-77fe-4b1a-8ef6-288a46514f97-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-853526bc-38d1-4018-ab3a-68ed23754f2f tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-ce2f62c6-790c-43e0-ac2d-b4f377f0a41e" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-853526bc-38d1-4018-ab3a-68ed23754f2f tempest-ProjectMemberTests-219511464 None] Deleting offline snapshot ce2f62c6-790c-43e0-ac2d-b4f377f0a41e of volume fad03189-d941-4bea-9cb6-11970f8d533d {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-853526bc-38d1-4018-ab3a-68ed23754f2f tempest-ProjectMemberTests-219511464 None] snapshot_file for this snap is: volume-fad03189-d941-4bea-9cb6-11970f8d533d.ce2f62c6-790c-43e0-ac2d-b4f377f0a41e {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c1e0dd-5bb2-4722-9e59-15621a77c3f2]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-853526bc-38d1-4018-ab3a-68ed23754f2f tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.ce2f62c6-790c-43e0-ac2d-b4f377f0a41e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-416534dd-c16e-45a5-8545-d3ed0fae3cf9 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "cinder-4c109f8e-77fe-4b1a-8ef6-288a46514f97-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-416534dd-c16e-45a5-8545-d3ed0fae3cf9 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "cinder-quobyte-4c109f8e-77fe-4b1a-8ef6-288a46514f97" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-416534dd-c16e-45a5-8545-d3ed0fae3cf9 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "cinder-quobyte-4c109f8e-77fe-4b1a-8ef6-288a46514f97" acquired by "delete_volume" :: waited 0.027s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4628b3d7-66e9-44de-9d3a-610bbe310a08]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-416534dd-c16e-45a5-8545-d3ed0fae3cf9 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4c109f8e-77fe-4b1a-8ef6-288a46514f97 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:27 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2d2d2b8d-2e03-4dd9-9d57-bfd0e1721424 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.341s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-2d2d2b8d-2e03-4dd9-9d57-bfd0e1721424 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:24:27 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.ce2f62c6-790c-43e0-ac2d-b4f377f0a41e Sep 06 08:24:27 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:27 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-2d2d2b8d-2e03-4dd9-9d57-bfd0e1721424 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Deleted volume successfully. Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2d2d2b8d-2e03-4dd9-9d57-bfd0e1721424 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "cinder-a4707447-c438-4085-b272-58a096229e3f-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:27 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66 1073741824" returned: 0 in 0.596s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:27 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4c109f8e-77fe-4b1a-8ef6-288a46514f97 Sep 06 08:24:27 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:27 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66 Sep 06 08:24:27 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:27 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-853526bc-38d1-4018-ab3a-68ed23754f2f tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.ce2f62c6-790c-43e0-ac2d-b4f377f0a41e" returned: 0 in 0.457s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-853526bc-38d1-4018-ab3a-68ed23754f2f tempest-ProjectMemberTests-219511464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fad03189-d941-4bea-9cb6-11970f8d533d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a47b142-f8a5-4dfa-8a3a-647a5e548bbf]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-853526bc-38d1-4018-ab3a-68ed23754f2f tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:27 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-416534dd-c16e-45a5-8545-d3ed0fae3cf9 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4c109f8e-77fe-4b1a-8ef6-288a46514f97" returned: 0 in 0.420s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-416534dd-c16e-45a5-8545-d3ed0fae3cf9 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4c109f8e-77fe-4b1a-8ef6-288a46514f97 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:27 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66" returned: 0 in 0.277s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:27 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4c109f8e-77fe-4b1a-8ef6-288a46514f97 Sep 06 08:24:27 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (750fb406-89ba-4acd-9a4e-8c6bdc6228ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad9a42bc-938a-4152-b515-3f0900643e66', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aaf6106-c036-4f06-beb9-412e43478acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:27 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Volume volume-ad9a42bc-938a-4152-b515-3f0900643e66 (ad9a42bc-938a-4152-b515-3f0900643e66): created successfully Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aaf6106-c036-4f06-beb9-412e43478acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:27 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Flow 'volume_create_manager' (1a764642-cef9-4bff-9995-a7d80922aaa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:27 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d Sep 06 08:24:27 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:27 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-0557aaa7-c8e1-4dcb-91c2-dacc4ecd27eb tempest-SnapshotDependencyTests-913184158 None] Created volume successfully. Sep 06 08:24:28 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-416534dd-c16e-45a5-8545-d3ed0fae3cf9 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4c109f8e-77fe-4b1a-8ef6-288a46514f97" returned: 0 in 0.257s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-416534dd-c16e-45a5-8545-d3ed0fae3cf9 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "cinder-quobyte-4c109f8e-77fe-4b1a-8ef6-288a46514f97" released by "delete_volume" :: held 0.724s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-416534dd-c16e-45a5-8545-d3ed0fae3cf9 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Created reservations ['1c87179f-d901-4850-b7c2-70d53d07e9b3', '67b4df51-6c56-4e2c-9617-031e5f466728', '50bde3af-5180-4af1-9336-def6f73a4544', '80b59d3b-fa7b-4304-a6cf-ab30902b3928'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:28 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-853526bc-38d1-4018-ab3a-68ed23754f2f tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d" returned: 0 in 0.389s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-853526bc-38d1-4018-ab3a-68ed23754f2f tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.ce2f62c6-790c-43e0-ac2d-b4f377f0a41e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:28 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.ce2f62c6-790c-43e0-ac2d-b4f377f0a41e Sep 06 08:24:28 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-416534dd-c16e-45a5-8545-d3ed0fae3cf9 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-416534dd-c16e-45a5-8545-d3ed0fae3cf9 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-416534dd-c16e-45a5-8545-d3ed0fae3cf9 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-416534dd-c16e-45a5-8545-d3ed0fae3cf9 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-416534dd-c16e-45a5-8545-d3ed0fae3cf9 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-416534dd-c16e-45a5-8545-d3ed0fae3cf9 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:28 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:24:28 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f287be3f-adf8-4945-bbb9-0577b1ac5315 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "cinder-7ecf2d21-5ab2-4a69-8206-3494b5a412b1-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f287be3f-adf8-4945-bbb9-0577b1ac5315 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "cinder-7ecf2d21-5ab2-4a69-8206-3494b5a412b1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f287be3f-adf8-4945-bbb9-0577b1ac5315 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "cinder-quobyte-7ecf2d21-5ab2-4a69-8206-3494b5a412b1" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f287be3f-adf8-4945-bbb9-0577b1ac5315 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "cinder-quobyte-7ecf2d21-5ab2-4a69-8206-3494b5a412b1" acquired by "delete_volume" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aba280b-9d83-40fb-a989-6981dff75e50]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f287be3f-adf8-4945-bbb9-0577b1ac5315 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7ecf2d21-5ab2-4a69-8206-3494b5a412b1 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:28 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-853526bc-38d1-4018-ab3a-68ed23754f2f tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.ce2f62c6-790c-43e0-ac2d-b4f377f0a41e" returned: 0 in 0.407s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-853526bc-38d1-4018-ab3a-68ed23754f2f tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.ce2f62c6-790c-43e0-ac2d-b4f377f0a41e {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:28 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-416534dd-c16e-45a5-8545-d3ed0fae3cf9 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.288s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-416534dd-c16e-45a5-8545-d3ed0fae3cf9 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:24:28 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-416534dd-c16e-45a5-8545-d3ed0fae3cf9 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Deleted volume successfully. Sep 06 08:24:28 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.ce2f62c6-790c-43e0-ac2d-b4f377f0a41e Sep 06 08:24:28 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-416534dd-c16e-45a5-8545-d3ed0fae3cf9 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "cinder-4c109f8e-77fe-4b1a-8ef6-288a46514f97-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:28 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7ecf2d21-5ab2-4a69-8206-3494b5a412b1 Sep 06 08:24:28 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:28 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-853526bc-38d1-4018-ab3a-68ed23754f2f tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d.ce2f62c6-790c-43e0-ac2d-b4f377f0a41e" returned: 0 in 0.276s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-853526bc-38d1-4018-ab3a-68ed23754f2f tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-ce2f62c6-790c-43e0-ac2d-b4f377f0a41e" released by "_delete_snapshot" :: held 1.646s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-853526bc-38d1-4018-ab3a-68ed23754f2f tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-fad03189-d941-4bea-9cb6-11970f8d533d" released by "delete_snapshot" :: held 1.694s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:28 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f287be3f-adf8-4945-bbb9-0577b1ac5315 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7ecf2d21-5ab2-4a69-8206-3494b5a412b1" returned: 0 in 0.395s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f287be3f-adf8-4945-bbb9-0577b1ac5315 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7ecf2d21-5ab2-4a69-8206-3494b5a412b1 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:29 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7ecf2d21-5ab2-4a69-8206-3494b5a412b1 Sep 06 08:24:29 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-853526bc-38d1-4018-ab3a-68ed23754f2f tempest-ProjectMemberTests-219511464 None] Created reservations ['2dd7acec-be92-4781-9fb6-89760eab916c', '1173470b-3cbd-459b-992c-862ce05ff276', '86adf071-6b4f-4f8b-bf38-5dc41e6c7163', 'be174491-c1b4-4f81-827e-51c3f8a21c4b'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:29 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-853526bc-38d1-4018-ab3a-68ed23754f2f tempest-ProjectMemberTests-219511464 None] Delete snapshot completed successfully. Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-853526bc-38d1-4018-ab3a-68ed23754f2f tempest-ProjectMemberTests-219511464 None] Lock "cinder-ce2f62c6-790c-43e0-ac2d-b4f377f0a41e-delete_snapshot" released by "delete_snapshot" :: held 1.865s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ed06e7db-c391-4d6a-a2fa-907a0e2d2b05 tempest-SnapshotDependencyTests-913184158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ed06e7db-c391-4d6a-a2fa-907a0e2d2b05 tempest-SnapshotDependencyTests-913184158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-ed06e7db-c391-4d6a-a2fa-907a0e2d2b05 tempest-SnapshotDependencyTests-913184158 None] Creating offline snapshot b805bb1f-6ad8-43a3-9cce-0426fbc4913c of volume ad9a42bc-938a-4152-b515-3f0900643e66 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:24:29 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f287be3f-adf8-4945-bbb9-0577b1ac5315 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7ecf2d21-5ab2-4a69-8206-3494b5a412b1" returned: 0 in 0.304s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dd538e-a4a7-456e-b24c-b72ab5ba89e5]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f287be3f-adf8-4945-bbb9-0577b1ac5315 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "cinder-quobyte-7ecf2d21-5ab2-4a69-8206-3494b5a412b1" released by "delete_volume" :: held 0.741s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed06e7db-c391-4d6a-a2fa-907a0e2d2b05 tempest-SnapshotDependencyTests-913184158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-f287be3f-adf8-4945-bbb9-0577b1ac5315 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Created reservations ['5280e118-ab8b-40be-95b4-506ade4e4fec', '2d1844f4-cc5d-44fd-a50e-ac4bbd0fb545', 'c7a56985-618a-4150-a484-c3ce311f75e0', '123d8037-75b6-4103-82d2-672fb8e46350'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ab62a339-de2a-4fcf-ad5e-7c54ef3d51c2 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-fad03189-d941-4bea-9cb6-11970f8d533d-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ab62a339-de2a-4fcf-ad5e-7c54ef3d51c2 tempest-ProjectMemberTests-219511464 None] Lock "cinder-fad03189-d941-4bea-9cb6-11970f8d533d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:29 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66 Sep 06 08:24:29 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f287be3f-adf8-4945-bbb9-0577b1ac5315 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f287be3f-adf8-4945-bbb9-0577b1ac5315 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f287be3f-adf8-4945-bbb9-0577b1ac5315 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f287be3f-adf8-4945-bbb9-0577b1ac5315 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f287be3f-adf8-4945-bbb9-0577b1ac5315 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f287be3f-adf8-4945-bbb9-0577b1ac5315 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ab62a339-de2a-4fcf-ad5e-7c54ef3d51c2 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-fad03189-d941-4bea-9cb6-11970f8d533d" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:29 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:24:29 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ab62a339-de2a-4fcf-ad5e-7c54ef3d51c2 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-fad03189-d941-4bea-9cb6-11970f8d533d" acquired by "delete_volume" :: waited 0.017s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac121d0f-8f63-4146-832b-7a1d87562c8d]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ab62a339-de2a-4fcf-ad5e-7c54ef3d51c2 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:29 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d Sep 06 08:24:29 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-35565c55-bf9f-4f70-b1c5-092330443875 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "cinder-750deb6b-3ebf-4519-8909-f1c1b4f8b729-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:29 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-35565c55-bf9f-4f70-b1c5-092330443875 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "cinder-750deb6b-3ebf-4519-8909-f1c1b4f8b729-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed06e7db-c391-4d6a-a2fa-907a0e2d2b05 tempest-SnapshotDependencyTests-913184158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66" returned: 0 in 0.410s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed06e7db-c391-4d6a-a2fa-907a0e2d2b05 tempest-SnapshotDependencyTests-913184158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.b805bb1f-6ad8-43a3-9cce-0426fbc4913c 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:29 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f287be3f-adf8-4945-bbb9-0577b1ac5315 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.277s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-f287be3f-adf8-4945-bbb9-0577b1ac5315 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:24:29 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f287be3f-adf8-4945-bbb9-0577b1ac5315 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Deleted volume successfully. Sep 06 08:24:29 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.b805bb1f-6ad8-43a3-9cce-0426fbc4913c 1G Sep 06 08:24:29 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-35565c55-bf9f-4f70-b1c5-092330443875 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "cinder-quobyte-750deb6b-3ebf-4519-8909-f1c1b4f8b729" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f287be3f-adf8-4945-bbb9-0577b1ac5315 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "cinder-7ecf2d21-5ab2-4a69-8206-3494b5a412b1-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-35565c55-bf9f-4f70-b1c5-092330443875 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "cinder-quobyte-750deb6b-3ebf-4519-8909-f1c1b4f8b729" acquired by "delete_volume" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2087aa-68be-48a4-84ba-158ee568070e]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-35565c55-bf9f-4f70-b1c5-092330443875 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-750deb6b-3ebf-4519-8909-f1c1b4f8b729 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:29 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-750deb6b-3ebf-4519-8909-f1c1b4f8b729 Sep 06 08:24:29 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:30 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ab62a339-de2a-4fcf-ad5e-7c54ef3d51c2 tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d" returned: 0 in 0.457s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ab62a339-de2a-4fcf-ad5e-7c54ef3d51c2 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:30 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d Sep 06 08:24:30 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:30 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed06e7db-c391-4d6a-a2fa-907a0e2d2b05 tempest-SnapshotDependencyTests-913184158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.b805bb1f-6ad8-43a3-9cce-0426fbc4913c 1G" returned: 0 in 0.457s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed06e7db-c391-4d6a-a2fa-907a0e2d2b05 tempest-SnapshotDependencyTests-913184158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad9a42bc-938a-4152-b515-3f0900643e66 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.b805bb1f-6ad8-43a3-9cce-0426fbc4913c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:30 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad9a42bc-938a-4152-b515-3f0900643e66 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.b805bb1f-6ad8-43a3-9cce-0426fbc4913c Sep 06 08:24:30 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:30 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-35565c55-bf9f-4f70-b1c5-092330443875 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-750deb6b-3ebf-4519-8909-f1c1b4f8b729" returned: 0 in 0.423s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-35565c55-bf9f-4f70-b1c5-092330443875 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-750deb6b-3ebf-4519-8909-f1c1b4f8b729 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:30 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-750deb6b-3ebf-4519-8909-f1c1b4f8b729 Sep 06 08:24:30 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:30 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ab62a339-de2a-4fcf-ad5e-7c54ef3d51c2 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-fad03189-d941-4bea-9cb6-11970f8d533d" returned: 0 in 0.290s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ab62a339-de2a-4fcf-ad5e-7c54ef3d51c2 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-fad03189-d941-4bea-9cb6-11970f8d533d" released by "delete_volume" :: held 0.817s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-ab62a339-de2a-4fcf-ad5e-7c54ef3d51c2 tempest-ProjectMemberTests-219511464 None] Created reservations ['eaf594aa-e70f-4efd-bccc-492f2dd6426f', '1914a46d-2a34-4cca-adfc-c77ed0257ae4', '42202cef-d1c1-441b-9f84-dc475520828d', 'c436cf3e-5962-4992-8c18-eee544307801'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ab62a339-de2a-4fcf-ad5e-7c54ef3d51c2 tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ab62a339-de2a-4fcf-ad5e-7c54ef3d51c2 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ab62a339-de2a-4fcf-ad5e-7c54ef3d51c2 tempest-ProjectMemberTests-219511464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ab62a339-de2a-4fcf-ad5e-7c54ef3d51c2 tempest-ProjectMemberTests-219511464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ab62a339-de2a-4fcf-ad5e-7c54ef3d51c2 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ab62a339-de2a-4fcf-ad5e-7c54ef3d51c2 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:30 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:24:30 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:30 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-35565c55-bf9f-4f70-b1c5-092330443875 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-750deb6b-3ebf-4519-8909-f1c1b4f8b729" returned: 0 in 0.264s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:30 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed06e7db-c391-4d6a-a2fa-907a0e2d2b05 tempest-SnapshotDependencyTests-913184158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad9a42bc-938a-4152-b515-3f0900643e66 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.b805bb1f-6ad8-43a3-9cce-0426fbc4913c" returned: 0 in 0.361s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:30 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-ed06e7db-c391-4d6a-a2fa-907a0e2d2b05 tempest-SnapshotDependencyTests-913184158 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.b805bb1f-6ad8-43a3-9cce-0426fbc4913c is being set with open permissions: ugo+rw Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed06e7db-c391-4d6a-a2fa-907a0e2d2b05 tempest-SnapshotDependencyTests-913184158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.b805bb1f-6ad8-43a3-9cce-0426fbc4913c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-35565c55-bf9f-4f70-b1c5-092330443875 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "cinder-quobyte-750deb6b-3ebf-4519-8909-f1c1b4f8b729" released by "delete_volume" :: held 0.741s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:30 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.b805bb1f-6ad8-43a3-9cce-0426fbc4913c Sep 06 08:24:30 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-35565c55-bf9f-4f70-b1c5-092330443875 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Created reservations ['47d1c630-bfb2-4dcf-ba81-4618406957ca', '1ffc1afb-c2cd-4e01-b9e9-869f5db42cdf', '451d5773-258a-4dcd-a00f-bc580e6fe70b', 'f54c1595-b435-4861-97aa-6378fdd279cc'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-35565c55-bf9f-4f70-b1c5-092330443875 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-35565c55-bf9f-4f70-b1c5-092330443875 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-35565c55-bf9f-4f70-b1c5-092330443875 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-35565c55-bf9f-4f70-b1c5-092330443875 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-35565c55-bf9f-4f70-b1c5-092330443875 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-35565c55-bf9f-4f70-b1c5-092330443875 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:30 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:24:30 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:30 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ab62a339-de2a-4fcf-ad5e-7c54ef3d51c2 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.323s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-ab62a339-de2a-4fcf-ad5e-7c54ef3d51c2 tempest-ProjectMemberTests-219511464 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:24:30 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-ab62a339-de2a-4fcf-ad5e-7c54ef3d51c2 tempest-ProjectMemberTests-219511464 None] Deleted volume successfully. Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ab62a339-de2a-4fcf-ad5e-7c54ef3d51c2 tempest-ProjectMemberTests-219511464 None] Lock "cinder-fad03189-d941-4bea-9cb6-11970f8d533d-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:30 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed06e7db-c391-4d6a-a2fa-907a0e2d2b05 tempest-SnapshotDependencyTests-913184158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.b805bb1f-6ad8-43a3-9cce-0426fbc4913c" returned: 0 in 0.314s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed06e7db-c391-4d6a-a2fa-907a0e2d2b05 tempest-SnapshotDependencyTests-913184158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-40c021e9-95e1-4df9-9399-98afdf6680b6 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "cinder-4c4cec6c-3701-46ce-905f-6116bfadc32d-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:30 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.info Sep 06 08:24:30 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:30 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-40c021e9-95e1-4df9-9399-98afdf6680b6 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "cinder-4c4cec6c-3701-46ce-905f-6116bfadc32d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:31 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-35565c55-bf9f-4f70-b1c5-092330443875 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.364s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-35565c55-bf9f-4f70-b1c5-092330443875 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-40c021e9-95e1-4df9-9399-98afdf6680b6 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "cinder-quobyte-4c4cec6c-3701-46ce-905f-6116bfadc32d" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:31 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-35565c55-bf9f-4f70-b1c5-092330443875 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Deleted volume successfully. Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-40c021e9-95e1-4df9-9399-98afdf6680b6 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "cinder-quobyte-4c4cec6c-3701-46ce-905f-6116bfadc32d" acquired by "delete_volume" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-35565c55-bf9f-4f70-b1c5-092330443875 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "cinder-750deb6b-3ebf-4519-8909-f1c1b4f8b729-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b796141f-ec01-4ee0-b3e1-7448ba6dbb44]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-40c021e9-95e1-4df9-9399-98afdf6680b6 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4c4cec6c-3701-46ce-905f-6116bfadc32d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Flow 'volume_create_manager' (7f3a1252-4e79-4247-975b-ee1ceb57464d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f60bf4-140d-46cf-8187-722922504ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:31 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4c4cec6c-3701-46ce-905f-6116bfadc32d Sep 06 08:24:31 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:31 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed06e7db-c391-4d6a-a2fa-907a0e2d2b05 tempest-SnapshotDependencyTests-913184158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.info" returned: 0 in 0.362s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:31 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-ed06e7db-c391-4d6a-a2fa-907a0e2d2b05 tempest-SnapshotDependencyTests-913184158 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.info is being set with open permissions: ugo+rw Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed06e7db-c391-4d6a-a2fa-907a0e2d2b05 tempest-SnapshotDependencyTests-913184158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f60bf4-140d-46cf-8187-722922504ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1428713457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f5a003-dd6b-4ae2-a337-5aa3ba92c093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57ff192bd0a74a27be0be1f1201231cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:31Z,use_quota=True,user_id='0f50a8b862534662bb877ccafabde4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:31 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.info Sep 06 08:24:31 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485c9627-8e64-44c5-a878-42cc991a8b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485c9627-8e64-44c5-a878-42cc991a8b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6548a5bc-f39e-49ce-ba82-3b6b51f05f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6548a5bc-f39e-49ce-ba82-3b6b51f05f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36f5a003-dd6b-4ae2-a337-5aa3ba92c093', 'volume_name': 'volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03abd912-aff3-4689-a067-95860bcfb2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03abd912-aff3-4689-a067-95860bcfb2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08bb74cb-0afa-47d3-8320-6f9bb31f7009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:31 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Volume 36f5a003-dd6b-4ae2-a337-5aa3ba92c093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093', 'volume_size': 1} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:31 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-40c021e9-95e1-4df9-9399-98afdf6680b6 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4c4cec6c-3701-46ce-905f-6116bfadc32d" returned: 0 in 0.386s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-40c021e9-95e1-4df9-9399-98afdf6680b6 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4c4cec6c-3701-46ce-905f-6116bfadc32d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:31 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ed06e7db-c391-4d6a-a2fa-907a0e2d2b05 tempest-SnapshotDependencyTests-913184158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.info" returned: 0 in 0.260s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:31 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4c4cec6c-3701-46ce-905f-6116bfadc32d Sep 06 08:24:31 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ed06e7db-c391-4d6a-a2fa-907a0e2d2b05 tempest-SnapshotDependencyTests-913184158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.274s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.217s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1428713457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f5a003-dd6b-4ae2-a337-5aa3ba92c093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57ff192bd0a74a27be0be1f1201231cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:31Z,use_quota=True,user_id='0f50a8b862534662bb877ccafabde4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Creating volume 36f5a003-dd6b-4ae2-a337-5aa3ba92c093 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:24:31 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:31 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093 1073741824 Sep 06 08:24:31 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:31 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-ed06e7db-c391-4d6a-a2fa-907a0e2d2b05 tempest-SnapshotDependencyTests-913184158 None] Create snapshot completed successfully Sep 06 08:24:31 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-40c021e9-95e1-4df9-9399-98afdf6680b6 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-4c4cec6c-3701-46ce-905f-6116bfadc32d" returned: 0 in 0.257s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-40c021e9-95e1-4df9-9399-98afdf6680b6 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "cinder-quobyte-4c4cec6c-3701-46ce-905f-6116bfadc32d" released by "delete_volume" :: held 0.695s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-40c021e9-95e1-4df9-9399-98afdf6680b6 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Created reservations ['a7fc86b9-dd59-49d6-b513-e95a091c71e7', '0b19ae60-5608-463e-9164-b0da09742581', '2a4e57f1-88ac-48f2-aeb8-61c67d89282f', '49140816-c9fc-4543-af44-0aaca87c3105'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-40c021e9-95e1-4df9-9399-98afdf6680b6 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-40c021e9-95e1-4df9-9399-98afdf6680b6 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-40c021e9-95e1-4df9-9399-98afdf6680b6 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-40c021e9-95e1-4df9-9399-98afdf6680b6 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-40c021e9-95e1-4df9-9399-98afdf6680b6 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-40c021e9-95e1-4df9-9399-98afdf6680b6 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:31 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:24:31 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:31 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093 1073741824" returned: 0 in 0.439s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:32 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093 Sep 06 08:24:32 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:32 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-40c021e9-95e1-4df9-9399-98afdf6680b6 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.266s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:32 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-40c021e9-95e1-4df9-9399-98afdf6680b6 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:24:32 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-40c021e9-95e1-4df9-9399-98afdf6680b6 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Deleted volume successfully. Sep 06 08:24:32 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-40c021e9-95e1-4df9-9399-98afdf6680b6 tempest-CreateVolumesFromSourceVolumeTest-1917554522 None] Lock "cinder-4c4cec6c-3701-46ce-905f-6116bfadc32d-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:32 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093" returned: 0 in 0.263s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:32 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:24:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08bb74cb-0afa-47d3-8320-6f9bb31f7009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6016a5a4-2fe9-4cdc-8119-64f3b09d47bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:32 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Volume volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093 (36f5a003-dd6b-4ae2-a337-5aa3ba92c093): created successfully Sep 06 08:24:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6016a5a4-2fe9-4cdc-8119-64f3b09d47bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:32 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Flow 'volume_create_manager' (7f3a1252-4e79-4247-975b-ee1ceb57464d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:32 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-60906309-4745-4cc2-b042-6fe3de7e3b12 tempest-ProjectMemberTests-219511464 None] Created volume successfully. Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Flow 'volume_create_manager' (6ee8b5f4-d31f-48d5-996d-888b54574f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b0f23f-04a8-4ddb-ad8f-f4b9d8c8fe47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b0f23f-04a8-4ddb-ad8f-f4b9d8c8fe47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecbbd5d9-2017-4669-89b8-3b30043fabe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2073adb0194c69b5bd65dfec383b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b805bb1f-6ad8-43a3-9cce-0426fbc4913c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:33Z,use_quota=True,user_id='d8ea0c5f3fda4d1090f4e20d1ba6e195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00af0ac8-7a88-4fbd-b59f-64aac82127d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00af0ac8-7a88-4fbd-b59f-64aac82127d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eddaa039-8e4a-4ff2-a66c-8c32b1a28684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eddaa039-8e4a-4ff2-a66c-8c32b1a28684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ecbbd5d9-2017-4669-89b8-3b30043fabe7', 'volume_name': 'volume-ecbbd5d9-2017-4669-89b8-3b30043fabe7', 'volume_size': 1, 'snapshot_id': 'b805bb1f-6ad8-43a3-9cce-0426fbc4913c'}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af5e3d5-f78c-48e3-badd-a262b417d4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af5e3d5-f78c-48e3-badd-a262b417d4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d285a63e-8cdf-4409-9f1b-5180f1f693f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:33 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Volume ecbbd5d9-2017-4669-89b8-3b30043fabe7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ecbbd5d9-2017-4669-89b8-3b30043fabe7', 'volume_size': 1, 'snapshot_id': 'b805bb1f-6ad8-43a3-9cce-0426fbc4913c'} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Acquiring lock "cinder-quobyte-b805bb1f-6ad8-43a3-9cce-0426fbc4913c-ecbbd5d9-2017-4669-89b8-3b30043fabe7" by "_create_volume_from_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Lock "cinder-quobyte-b805bb1f-6ad8-43a3-9cce-0426fbc4913c-ecbbd5d9-2017-4669-89b8-3b30043fabe7" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Creating volume ecbbd5d9-2017-4669-89b8-3b30043fabe7 from snapshot b805bb1f-6ad8-43a3-9cce-0426fbc4913c {{(pid=87307) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Acquiring lock "cinder-quobyte-ecbbd5d9-2017-4669-89b8-3b30043fabe7" by "_copy_volume_from_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Lock "cinder-quobyte-ecbbd5d9-2017-4669-89b8-3b30043fabe7" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] snapshot: b805bb1f-6ad8-43a3-9cce-0426fbc4913c, volume: ecbbd5d9-2017-4669-89b8-3b30043fabe7, {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd298d3-b44f-4203-a325-ecd9d4c98129]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.b805bb1f-6ad8-43a3-9cce-0426fbc4913c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:33 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.b805bb1f-6ad8-43a3-9cce-0426fbc4913c Sep 06 08:24:33 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ab019c64-31e1-4df5-aac8-9b21d66ed44d tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:33 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.b805bb1f-6ad8-43a3-9cce-0426fbc4913c" returned: 0 in 0.433s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad9a42bc-938a-4152-b515-3f0900643e66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6aa598d-df82-4e5c-acf0-f234ed44027e]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:33 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66 Sep 06 08:24:33 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:34 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66" returned: 0 in 0.387s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] will copy from snapshot at /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66 {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 06 08:24:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Creating direct copy from snapshot {{(pid=87307) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 06 08:24:34 devstack cinder-volume[87307]: DEBUG cinder.utils [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Path /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ecbbd5d9-2017-4669-89b8-3b30043fabe7 not found in is_blk_device check {{(pid=87307) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 06 08:24:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ecbbd5d9-2017-4669-89b8-3b30043fabe7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:34 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ecbbd5d9-2017-4669-89b8-3b30043fabe7 Sep 06 08:24:34 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:36 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6ab4311e-452a-4457-9bfc-05d96e39d28c tempest-ProjectAdminTests-594730620 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.665195465088, 'free_capacity_gb': 1773.665195465088, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87307) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 06 08:24:38 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ecbbd5d9-2017-4669-89b8-3b30043fabe7" returned: 0 in 4.805s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:38 devstack cinder-volume[87307]: DEBUG cinder.image.image_utils [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Image conversion details: src /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66, size 1024.00 MB, duration 4.81 sec, destination /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ecbbd5d9-2017-4669-89b8-3b30043fabe7 {{(pid=87307) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 08:24:38 devstack cinder-volume[87307]: INFO cinder.image.image_utils [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Converted 1024.00 MB image at 213.06 MB/s Sep 06 08:24:38 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ecbbd5d9-2017-4669-89b8-3b30043fabe7 is being set with open permissions: ugo+rw Sep 06 08:24:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ecbbd5d9-2017-4669-89b8-3b30043fabe7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:38 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ecbbd5d9-2017-4669-89b8-3b30043fabe7 Sep 06 08:24:38 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:39 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ecbbd5d9-2017-4669-89b8-3b30043fabe7" returned: 0 in 0.261s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:39 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Lock "cinder-quobyte-ecbbd5d9-2017-4669-89b8-3b30043fabe7" released by "_copy_volume_from_snapshot" :: held 5.996s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:39 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Lock "cinder-quobyte-b805bb1f-6ad8-43a3-9cce-0426fbc4913c-ecbbd5d9-2017-4669-89b8-3b30043fabe7" released by "_create_volume_from_snapshot" :: held 6.078s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.099s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ab019c64-31e1-4df5-aac8-9b21d66ed44d tempest-ProjectMemberTests-219511464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.772s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:39 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-ab019c64-31e1-4df5-aac8-9b21d66ed44d tempest-ProjectMemberTests-219511464 None] Creating offline snapshot f2564465-9757-417f-a965-1ea809bd22dc of volume 36f5a003-dd6b-4ae2-a337-5aa3ba92c093 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:24:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d285a63e-8cdf-4409-9f1b-5180f1f693f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecbbd5d9-2017-4669-89b8-3b30043fabe7', 'volume_size': 1, 'snapshot_id': 'b805bb1f-6ad8-43a3-9cce-0426fbc4913c'}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10245665-b549-47f7-be8e-b66cfbf43708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:39 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c5f301-d837-4fce-afe1-47c30178514b]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ab019c64-31e1-4df5-aac8-9b21d66ed44d tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:39 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Volume volume-ecbbd5d9-2017-4669-89b8-3b30043fabe7 (ecbbd5d9-2017-4669-89b8-3b30043fabe7): created successfully Sep 06 08:24:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10245665-b549-47f7-be8e-b66cfbf43708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:39 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Flow 'volume_create_manager' (6ee8b5f4-d31f-48d5-996d-888b54574f11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:39 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-b4b922fa-de29-4e17-ba99-288ee3b1eaea tempest-SnapshotDependencyTests-913184158 None] Created volume successfully. Sep 06 08:24:39 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093 Sep 06 08:24:39 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:39 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ab019c64-31e1-4df5-aac8-9b21d66ed44d tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093" returned: 0 in 0.409s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ab019c64-31e1-4df5-aac8-9b21d66ed44d tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.f2564465-9757-417f-a965-1ea809bd22dc 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:39 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.f2564465-9757-417f-a965-1ea809bd22dc 1G Sep 06 08:24:39 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-17c8623e-459b-4b66-a510-932c28376fa2 tempest-SnapshotDependencyTests-913184158 None] Acquiring lock "cinder-b805bb1f-6ad8-43a3-9cce-0426fbc4913c-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-17c8623e-459b-4b66-a510-932c28376fa2 tempest-SnapshotDependencyTests-913184158 None] Lock "cinder-b805bb1f-6ad8-43a3-9cce-0426fbc4913c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-17c8623e-459b-4b66-a510-932c28376fa2 tempest-SnapshotDependencyTests-913184158 None] Acquiring lock "cinder-quobyte-ad9a42bc-938a-4152-b515-3f0900643e66" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-17c8623e-459b-4b66-a510-932c28376fa2 tempest-SnapshotDependencyTests-913184158 None] Lock "cinder-quobyte-ad9a42bc-938a-4152-b515-3f0900643e66" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-17c8623e-459b-4b66-a510-932c28376fa2 tempest-SnapshotDependencyTests-913184158 None] Acquiring lock "cinder-quobyte-b805bb1f-6ad8-43a3-9cce-0426fbc4913c" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-17c8623e-459b-4b66-a510-932c28376fa2 tempest-SnapshotDependencyTests-913184158 None] Lock "cinder-quobyte-b805bb1f-6ad8-43a3-9cce-0426fbc4913c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-17c8623e-459b-4b66-a510-932c28376fa2 tempest-SnapshotDependencyTests-913184158 None] Deleting offline snapshot b805bb1f-6ad8-43a3-9cce-0426fbc4913c of volume ad9a42bc-938a-4152-b515-3f0900643e66 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:24:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-17c8623e-459b-4b66-a510-932c28376fa2 tempest-SnapshotDependencyTests-913184158 None] snapshot_file for this snap is: volume-ad9a42bc-938a-4152-b515-3f0900643e66.b805bb1f-6ad8-43a3-9cce-0426fbc4913c {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:24:40 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[209ffd86-d738-491c-b4d5-ee52926d8369]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-17c8623e-459b-4b66-a510-932c28376fa2 tempest-SnapshotDependencyTests-913184158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.b805bb1f-6ad8-43a3-9cce-0426fbc4913c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:40 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ab019c64-31e1-4df5-aac8-9b21d66ed44d tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.f2564465-9757-417f-a965-1ea809bd22dc 1G" returned: 0 in 0.459s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ab019c64-31e1-4df5-aac8-9b21d66ed44d tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.f2564465-9757-417f-a965-1ea809bd22dc {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:40 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.f2564465-9757-417f-a965-1ea809bd22dc Sep 06 08:24:40 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:40 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.b805bb1f-6ad8-43a3-9cce-0426fbc4913c Sep 06 08:24:40 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:40 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ab019c64-31e1-4df5-aac8-9b21d66ed44d tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.f2564465-9757-417f-a965-1ea809bd22dc" returned: 0 in 0.306s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:40 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-ab019c64-31e1-4df5-aac8-9b21d66ed44d tempest-ProjectMemberTests-219511464 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.f2564465-9757-417f-a965-1ea809bd22dc is being set with open permissions: ugo+rw Sep 06 08:24:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ab019c64-31e1-4df5-aac8-9b21d66ed44d tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.f2564465-9757-417f-a965-1ea809bd22dc {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:40 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-17c8623e-459b-4b66-a510-932c28376fa2 tempest-SnapshotDependencyTests-913184158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.b805bb1f-6ad8-43a3-9cce-0426fbc4913c" returned: 0 in 0.402s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:40 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-17c8623e-459b-4b66-a510-932c28376fa2 tempest-SnapshotDependencyTests-913184158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad9a42bc-938a-4152-b515-3f0900643e66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:24:40 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.f2564465-9757-417f-a965-1ea809bd22dc Sep 06 08:24:40 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:40 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[570fd4e8-a0cd-4c31-a14b-bb3debcfdfe3]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-17c8623e-459b-4b66-a510-932c28376fa2 tempest-SnapshotDependencyTests-913184158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:40 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66 Sep 06 08:24:40 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:40 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ab019c64-31e1-4df5-aac8-9b21d66ed44d tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.f2564465-9757-417f-a965-1ea809bd22dc" returned: 0 in 0.276s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ab019c64-31e1-4df5-aac8-9b21d66ed44d tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:40 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.info Sep 06 08:24:40 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:41 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ab019c64-31e1-4df5-aac8-9b21d66ed44d tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.info" returned: 0 in 0.287s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:41 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-ab019c64-31e1-4df5-aac8-9b21d66ed44d tempest-ProjectMemberTests-219511464 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.info is being set with open permissions: ugo+rw Sep 06 08:24:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ab019c64-31e1-4df5-aac8-9b21d66ed44d tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:41 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.info Sep 06 08:24:41 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:41 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-17c8623e-459b-4b66-a510-932c28376fa2 tempest-SnapshotDependencyTests-913184158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66" returned: 0 in 0.608s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-17c8623e-459b-4b66-a510-932c28376fa2 tempest-SnapshotDependencyTests-913184158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.b805bb1f-6ad8-43a3-9cce-0426fbc4913c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:41 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.b805bb1f-6ad8-43a3-9cce-0426fbc4913c Sep 06 08:24:41 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:41 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ab019c64-31e1-4df5-aac8-9b21d66ed44d tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.info" returned: 0 in 0.277s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ab019c64-31e1-4df5-aac8-9b21d66ed44d tempest-ProjectMemberTests-219511464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.121s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:41 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-ab019c64-31e1-4df5-aac8-9b21d66ed44d tempest-ProjectMemberTests-219511464 None] Create snapshot completed successfully Sep 06 08:24:41 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-17c8623e-459b-4b66-a510-932c28376fa2 tempest-SnapshotDependencyTests-913184158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.b805bb1f-6ad8-43a3-9cce-0426fbc4913c" returned: 0 in 0.357s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-17c8623e-459b-4b66-a510-932c28376fa2 tempest-SnapshotDependencyTests-913184158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.b805bb1f-6ad8-43a3-9cce-0426fbc4913c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:41 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.b805bb1f-6ad8-43a3-9cce-0426fbc4913c Sep 06 08:24:41 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:41 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-17c8623e-459b-4b66-a510-932c28376fa2 tempest-SnapshotDependencyTests-913184158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66.b805bb1f-6ad8-43a3-9cce-0426fbc4913c" returned: 0 in 0.264s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:41 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-17c8623e-459b-4b66-a510-932c28376fa2 tempest-SnapshotDependencyTests-913184158 None] Lock "cinder-quobyte-b805bb1f-6ad8-43a3-9cce-0426fbc4913c" released by "_delete_snapshot" :: held 1.758s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:41 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-17c8623e-459b-4b66-a510-932c28376fa2 tempest-SnapshotDependencyTests-913184158 None] Lock "cinder-quobyte-ad9a42bc-938a-4152-b515-3f0900643e66" released by "delete_snapshot" :: held 1.789s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:41 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-17c8623e-459b-4b66-a510-932c28376fa2 tempest-SnapshotDependencyTests-913184158 None] Created reservations ['7565f06e-dd19-416a-86bf-46f9a3483154', '1c5e46b1-c848-4b4e-9707-cae8632aedb4', '682a6e14-90d6-41b0-8a49-bf93a1c6bff5', 'cf48ee85-9eee-4963-9a61-1949016902b3'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:41 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-17c8623e-459b-4b66-a510-932c28376fa2 tempest-SnapshotDependencyTests-913184158 None] Delete snapshot completed successfully. Sep 06 08:24:41 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-17c8623e-459b-4b66-a510-932c28376fa2 tempest-SnapshotDependencyTests-913184158 None] Lock "cinder-b805bb1f-6ad8-43a3-9cce-0426fbc4913c-delete_snapshot" released by "delete_snapshot" :: held 1.952s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f2d157f1-c852-476e-89c3-e50f2e406c87 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-f2564465-9757-417f-a965-1ea809bd22dc-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f2d157f1-c852-476e-89c3-e50f2e406c87 tempest-ProjectMemberTests-219511464 None] Lock "cinder-f2564465-9757-417f-a965-1ea809bd22dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f2d157f1-c852-476e-89c3-e50f2e406c87 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-36f5a003-dd6b-4ae2-a337-5aa3ba92c093" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f2d157f1-c852-476e-89c3-e50f2e406c87 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-36f5a003-dd6b-4ae2-a337-5aa3ba92c093" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f2d157f1-c852-476e-89c3-e50f2e406c87 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-f2564465-9757-417f-a965-1ea809bd22dc" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f2d157f1-c852-476e-89c3-e50f2e406c87 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-f2564465-9757-417f-a965-1ea809bd22dc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f2d157f1-c852-476e-89c3-e50f2e406c87 tempest-ProjectMemberTests-219511464 None] Deleting offline snapshot f2564465-9757-417f-a965-1ea809bd22dc of volume 36f5a003-dd6b-4ae2-a337-5aa3ba92c093 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f2d157f1-c852-476e-89c3-e50f2e406c87 tempest-ProjectMemberTests-219511464 None] snapshot_file for this snap is: volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.f2564465-9757-417f-a965-1ea809bd22dc {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df3535c-ba2f-40f6-8a06-54a30b6027a8]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f2d157f1-c852-476e-89c3-e50f2e406c87 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.f2564465-9757-417f-a965-1ea809bd22dc {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-d6925f83-179b-4519-8f40-94bd50b05de4 tempest-SnapshotDependencyTests-913184158 None] Acquiring lock "cinder-ad9a42bc-938a-4152-b515-3f0900643e66-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-d6925f83-179b-4519-8f40-94bd50b05de4 tempest-SnapshotDependencyTests-913184158 None] Lock "cinder-ad9a42bc-938a-4152-b515-3f0900643e66-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-d6925f83-179b-4519-8f40-94bd50b05de4 tempest-SnapshotDependencyTests-913184158 None] Acquiring lock "cinder-quobyte-ad9a42bc-938a-4152-b515-3f0900643e66" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-d6925f83-179b-4519-8f40-94bd50b05de4 tempest-SnapshotDependencyTests-913184158 None] Lock "cinder-quobyte-ad9a42bc-938a-4152-b515-3f0900643e66" acquired by "delete_volume" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:42 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.f2564465-9757-417f-a965-1ea809bd22dc Sep 06 08:24:42 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30d9727-9319-43dc-812d-a0468947b406]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d6925f83-179b-4519-8f40-94bd50b05de4 tempest-SnapshotDependencyTests-913184158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:42 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66 Sep 06 08:24:42 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:42 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f2d157f1-c852-476e-89c3-e50f2e406c87 tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.f2564465-9757-417f-a965-1ea809bd22dc" returned: 0 in 0.392s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f2d157f1-c852-476e-89c3-e50f2e406c87 tempest-ProjectMemberTests-219511464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefef9b0-afa1-443f-b913-20a555f7885f]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f2d157f1-c852-476e-89c3-e50f2e406c87 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:42 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:42 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093 Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d6925f83-179b-4519-8f40-94bd50b05de4 tempest-SnapshotDependencyTests-913184158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66" returned: 0 in 0.382s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d6925f83-179b-4519-8f40-94bd50b05de4 tempest-SnapshotDependencyTests-913184158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:42 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:42 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66 Sep 06 08:24:42 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:42 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d6925f83-179b-4519-8f40-94bd50b05de4 tempest-SnapshotDependencyTests-913184158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad9a42bc-938a-4152-b515-3f0900643e66" returned: 0 in 0.240s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-d6925f83-179b-4519-8f40-94bd50b05de4 tempest-SnapshotDependencyTests-913184158 None] Lock "cinder-quobyte-ad9a42bc-938a-4152-b515-3f0900643e66" released by "delete_volume" :: held 0.684s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:42 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f2d157f1-c852-476e-89c3-e50f2e406c87 tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093" returned: 0 in 0.387s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:42 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f2d157f1-c852-476e-89c3-e50f2e406c87 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.f2564465-9757-417f-a965-1ea809bd22dc {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:42 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.f2564465-9757-417f-a965-1ea809bd22dc Sep 06 08:24:42 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-d6925f83-179b-4519-8f40-94bd50b05de4 tempest-SnapshotDependencyTests-913184158 None] Created reservations ['571d098e-3029-48ac-876f-fefe586879e7', 'cea428a3-9ac7-4f54-a86c-c4eca40c1356', 'edc6632f-98e4-4145-9350-8ec0a6e718e5', 'f112c693-bc4c-4fb2-b09f-b2b810145500'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d6925f83-179b-4519-8f40-94bd50b05de4 tempest-SnapshotDependencyTests-913184158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d6925f83-179b-4519-8f40-94bd50b05de4 tempest-SnapshotDependencyTests-913184158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d6925f83-179b-4519-8f40-94bd50b05de4 tempest-SnapshotDependencyTests-913184158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d6925f83-179b-4519-8f40-94bd50b05de4 tempest-SnapshotDependencyTests-913184158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d6925f83-179b-4519-8f40-94bd50b05de4 tempest-SnapshotDependencyTests-913184158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d6925f83-179b-4519-8f40-94bd50b05de4 tempest-SnapshotDependencyTests-913184158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:43 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:24:43 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:43 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f2d157f1-c852-476e-89c3-e50f2e406c87 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.f2564465-9757-417f-a965-1ea809bd22dc" returned: 0 in 0.404s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f2d157f1-c852-476e-89c3-e50f2e406c87 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.f2564465-9757-417f-a965-1ea809bd22dc {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-69b2ad0c-f126-4709-9aab-ec1704b70f20 tempest-SnapshotDependencyTests-913184158 None] Acquiring lock "cinder-ecbbd5d9-2017-4669-89b8-3b30043fabe7-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:43 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.f2564465-9757-417f-a965-1ea809bd22dc Sep 06 08:24:43 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:43 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-69b2ad0c-f126-4709-9aab-ec1704b70f20 tempest-SnapshotDependencyTests-913184158 None] Lock "cinder-ecbbd5d9-2017-4669-89b8-3b30043fabe7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d6925f83-179b-4519-8f40-94bd50b05de4 tempest-SnapshotDependencyTests-913184158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.334s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-d6925f83-179b-4519-8f40-94bd50b05de4 tempest-SnapshotDependencyTests-913184158 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:24:43 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-d6925f83-179b-4519-8f40-94bd50b05de4 tempest-SnapshotDependencyTests-913184158 None] Deleted volume successfully. Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-d6925f83-179b-4519-8f40-94bd50b05de4 tempest-SnapshotDependencyTests-913184158 None] Lock "cinder-ad9a42bc-938a-4152-b515-3f0900643e66-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-69b2ad0c-f126-4709-9aab-ec1704b70f20 tempest-SnapshotDependencyTests-913184158 None] Acquiring lock "cinder-quobyte-ecbbd5d9-2017-4669-89b8-3b30043fabe7" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-69b2ad0c-f126-4709-9aab-ec1704b70f20 tempest-SnapshotDependencyTests-913184158 None] Lock "cinder-quobyte-ecbbd5d9-2017-4669-89b8-3b30043fabe7" acquired by "delete_volume" :: waited 0.017s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7028ded8-a3a4-4f47-a041-c973fd31f2f0]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-69b2ad0c-f126-4709-9aab-ec1704b70f20 tempest-SnapshotDependencyTests-913184158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ecbbd5d9-2017-4669-89b8-3b30043fabe7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:43 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ecbbd5d9-2017-4669-89b8-3b30043fabe7 Sep 06 08:24:43 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:43 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f2d157f1-c852-476e-89c3-e50f2e406c87 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093.f2564465-9757-417f-a965-1ea809bd22dc" returned: 0 in 0.289s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f2d157f1-c852-476e-89c3-e50f2e406c87 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-f2564465-9757-417f-a965-1ea809bd22dc" released by "_delete_snapshot" :: held 1.582s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f2d157f1-c852-476e-89c3-e50f2e406c87 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-36f5a003-dd6b-4ae2-a337-5aa3ba92c093" released by "delete_snapshot" :: held 1.613s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-f2d157f1-c852-476e-89c3-e50f2e406c87 tempest-ProjectMemberTests-219511464 None] Created reservations ['b9793e39-ec0f-42cf-bb7a-1391508a6175', 'be6fd1c4-f096-43ee-868e-95e5302d73d0', 'fb788c38-802f-4539-ba30-76889ea31619', '481dd3bd-0542-4a60-89ed-33a8d629aa0d'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:43 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f2d157f1-c852-476e-89c3-e50f2e406c87 tempest-ProjectMemberTests-219511464 None] Delete snapshot completed successfully. Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f2d157f1-c852-476e-89c3-e50f2e406c87 tempest-ProjectMemberTests-219511464 None] Lock "cinder-f2564465-9757-417f-a965-1ea809bd22dc-delete_snapshot" released by "delete_snapshot" :: held 1.788s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:43 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-69b2ad0c-f126-4709-9aab-ec1704b70f20 tempest-SnapshotDependencyTests-913184158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ecbbd5d9-2017-4669-89b8-3b30043fabe7" returned: 0 in 0.427s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:43 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-69b2ad0c-f126-4709-9aab-ec1704b70f20 tempest-SnapshotDependencyTests-913184158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ecbbd5d9-2017-4669-89b8-3b30043fabe7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:43 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ecbbd5d9-2017-4669-89b8-3b30043fabe7 Sep 06 08:24:43 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:44 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-69b2ad0c-f126-4709-9aab-ec1704b70f20 tempest-SnapshotDependencyTests-913184158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ecbbd5d9-2017-4669-89b8-3b30043fabe7" returned: 0 in 0.254s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-69b2ad0c-f126-4709-9aab-ec1704b70f20 tempest-SnapshotDependencyTests-913184158 None] Lock "cinder-quobyte-ecbbd5d9-2017-4669-89b8-3b30043fabe7" released by "delete_volume" :: held 0.721s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ef847532-2d80-4839-b79e-3de6661cf73b tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-36f5a003-dd6b-4ae2-a337-5aa3ba92c093-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ef847532-2d80-4839-b79e-3de6661cf73b tempest-ProjectMemberTests-219511464 None] Lock "cinder-36f5a003-dd6b-4ae2-a337-5aa3ba92c093-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ef847532-2d80-4839-b79e-3de6661cf73b tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-36f5a003-dd6b-4ae2-a337-5aa3ba92c093" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:44 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-69b2ad0c-f126-4709-9aab-ec1704b70f20 tempest-SnapshotDependencyTests-913184158 None] Created reservations ['b53edb0d-d340-454c-89ff-6adc58376cd4', '8746f92a-1626-418c-b372-629052611892', '40e15554-409d-4de8-8332-6d9414a2e733', '76e352e5-2145-4418-9def-ca72ce5496e1'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ef847532-2d80-4839-b79e-3de6661cf73b tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-36f5a003-dd6b-4ae2-a337-5aa3ba92c093" acquired by "delete_volume" :: waited 0.025s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:44 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd26bcb4-80ed-4783-9ba2-3430f2dfe172]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ef847532-2d80-4839-b79e-3de6661cf73b tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-69b2ad0c-f126-4709-9aab-ec1704b70f20 tempest-SnapshotDependencyTests-913184158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-69b2ad0c-f126-4709-9aab-ec1704b70f20 tempest-SnapshotDependencyTests-913184158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:44 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-69b2ad0c-f126-4709-9aab-ec1704b70f20 tempest-SnapshotDependencyTests-913184158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:44 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-69b2ad0c-f126-4709-9aab-ec1704b70f20 tempest-SnapshotDependencyTests-913184158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-69b2ad0c-f126-4709-9aab-ec1704b70f20 tempest-SnapshotDependencyTests-913184158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-69b2ad0c-f126-4709-9aab-ec1704b70f20 tempest-SnapshotDependencyTests-913184158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:44 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:24:44 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:44 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093 Sep 06 08:24:44 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:44 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-69b2ad0c-f126-4709-9aab-ec1704b70f20 tempest-SnapshotDependencyTests-913184158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.269s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:44 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-69b2ad0c-f126-4709-9aab-ec1704b70f20 tempest-SnapshotDependencyTests-913184158 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:24:44 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-69b2ad0c-f126-4709-9aab-ec1704b70f20 tempest-SnapshotDependencyTests-913184158 None] Deleted volume successfully. Sep 06 08:24:44 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-69b2ad0c-f126-4709-9aab-ec1704b70f20 tempest-SnapshotDependencyTests-913184158 None] Lock "cinder-ecbbd5d9-2017-4669-89b8-3b30043fabe7-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:44 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ef847532-2d80-4839-b79e-3de6661cf73b tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093" returned: 0 in 0.397s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:44 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ef847532-2d80-4839-b79e-3de6661cf73b tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:44 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093 Sep 06 08:24:44 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:45 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ef847532-2d80-4839-b79e-3de6661cf73b tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-36f5a003-dd6b-4ae2-a337-5aa3ba92c093" returned: 0 in 0.255s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ef847532-2d80-4839-b79e-3de6661cf73b tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-36f5a003-dd6b-4ae2-a337-5aa3ba92c093" released by "delete_volume" :: held 0.723s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:45 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-ef847532-2d80-4839-b79e-3de6661cf73b tempest-ProjectMemberTests-219511464 None] Created reservations ['6262455b-faef-4250-8779-b5822e6fbca8', '5bc0892c-1f99-4b92-80dd-3a6cc974dbe9', 'ed6991ff-2411-42dd-b421-c5ff3ec54690', '457b53e2-1e40-451b-9e21-847367b1c362'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ef847532-2d80-4839-b79e-3de6661cf73b tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ef847532-2d80-4839-b79e-3de6661cf73b tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ef847532-2d80-4839-b79e-3de6661cf73b tempest-ProjectMemberTests-219511464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:45 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-ef847532-2d80-4839-b79e-3de6661cf73b tempest-ProjectMemberTests-219511464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ef847532-2d80-4839-b79e-3de6661cf73b tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ef847532-2d80-4839-b79e-3de6661cf73b tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:45 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:24:45 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:45 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:45 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ef847532-2d80-4839-b79e-3de6661cf73b tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.334s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:45 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-ef847532-2d80-4839-b79e-3de6661cf73b tempest-ProjectMemberTests-219511464 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:24:45 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-ef847532-2d80-4839-b79e-3de6661cf73b tempest-ProjectMemberTests-219511464 None] Deleted volume successfully. Sep 06 08:24:45 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-ef847532-2d80-4839-b79e-3de6661cf73b tempest-ProjectMemberTests-219511464 None] Lock "cinder-36f5a003-dd6b-4ae2-a337-5aa3ba92c093-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:45 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:24:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Flow 'volume_create_manager' (537b742d-ef2d-4d4e-bbed-1982b6e6120e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:45 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5182990-af77-47ae-9239-df01afaf76e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5182990-af77-47ae-9239-df01afaf76e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-484888959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c15e5fd4-047f-4d68-aef4-03dca28fa83a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57ff192bd0a74a27be0be1f1201231cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:46Z,use_quota=True,user_id='0f50a8b862534662bb877ccafabde4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1281a9-3a10-4a8b-9b4a-f9484b02a37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1281a9-3a10-4a8b-9b4a-f9484b02a37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89642e8f-1efe-4ca7-a516-2ce32ad7baf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89642e8f-1efe-4ca7-a516-2ce32ad7baf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c15e5fd4-047f-4d68-aef4-03dca28fa83a', 'volume_name': 'volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f8f17c-9e00-4e1a-ad13-d54b22a07270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f8f17c-9e00-4e1a-ad13-d54b22a07270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (521f9273-b091-4232-9356-e1bb31cb2717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:46 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Volume c15e5fd4-047f-4d68-aef4-03dca28fa83a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a', 'volume_size': 1} Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-484888959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c15e5fd4-047f-4d68-aef4-03dca28fa83a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57ff192bd0a74a27be0be1f1201231cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:46Z,use_quota=True,user_id='0f50a8b862534662bb877ccafabde4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Creating volume c15e5fd4-047f-4d68-aef4-03dca28fa83a {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:24:46 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:46 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a 1073741824 Sep 06 08:24:46 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:46 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a 1073741824" returned: 0 in 0.441s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:46 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a Sep 06 08:24:46 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:46 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a" returned: 0 in 0.259s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (521f9273-b091-4232-9356-e1bb31cb2717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0204b63-2572-4566-8d99-2501b189a60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:46 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Volume volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a (c15e5fd4-047f-4d68-aef4-03dca28fa83a): created successfully Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0204b63-2572-4566-8d99-2501b189a60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:46 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Flow 'volume_create_manager' (537b742d-ef2d-4d4e-bbed-1982b6e6120e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:46 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-06ef0665-005c-4071-991f-51d5b824a91d tempest-ProjectMemberTests-219511464 None] Created volume successfully. Sep 06 08:24:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f7eb7835-a461-4b02-ab10-47a6bc369cab tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f7eb7835-a461-4b02-ab10-47a6bc369cab tempest-ProjectMemberTests-219511464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:48 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f7eb7835-a461-4b02-ab10-47a6bc369cab tempest-ProjectMemberTests-219511464 None] Creating offline snapshot 865a6c83-23cd-4df9-ae50-3a9156ba41ad of volume c15e5fd4-047f-4d68-aef4-03dca28fa83a {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:24:48 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6331505c-4763-4f81-a672-1d32b683f10b]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7eb7835-a461-4b02-ab10-47a6bc369cab tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:48 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a Sep 06 08:24:48 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:48 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7eb7835-a461-4b02-ab10-47a6bc369cab tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a" returned: 0 in 0.466s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:48 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7eb7835-a461-4b02-ab10-47a6bc369cab tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.865a6c83-23cd-4df9-ae50-3a9156ba41ad 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:48 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.865a6c83-23cd-4df9-ae50-3a9156ba41ad 1G Sep 06 08:24:48 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:49 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7eb7835-a461-4b02-ab10-47a6bc369cab tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.865a6c83-23cd-4df9-ae50-3a9156ba41ad 1G" returned: 0 in 0.586s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7eb7835-a461-4b02-ab10-47a6bc369cab tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.865a6c83-23cd-4df9-ae50-3a9156ba41ad {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:49 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.865a6c83-23cd-4df9-ae50-3a9156ba41ad Sep 06 08:24:49 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:49 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7eb7835-a461-4b02-ab10-47a6bc369cab tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.865a6c83-23cd-4df9-ae50-3a9156ba41ad" returned: 0 in 0.342s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:49 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-f7eb7835-a461-4b02-ab10-47a6bc369cab tempest-ProjectMemberTests-219511464 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.865a6c83-23cd-4df9-ae50-3a9156ba41ad is being set with open permissions: ugo+rw Sep 06 08:24:49 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7eb7835-a461-4b02-ab10-47a6bc369cab tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.865a6c83-23cd-4df9-ae50-3a9156ba41ad {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:49 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.865a6c83-23cd-4df9-ae50-3a9156ba41ad Sep 06 08:24:49 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:50 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7eb7835-a461-4b02-ab10-47a6bc369cab tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.865a6c83-23cd-4df9-ae50-3a9156ba41ad" returned: 0 in 0.286s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7eb7835-a461-4b02-ab10-47a6bc369cab tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:50 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.info Sep 06 08:24:50 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:50 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7eb7835-a461-4b02-ab10-47a6bc369cab tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.info" returned: 0 in 0.340s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:50 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-f7eb7835-a461-4b02-ab10-47a6bc369cab tempest-ProjectMemberTests-219511464 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.info is being set with open permissions: ugo+rw Sep 06 08:24:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7eb7835-a461-4b02-ab10-47a6bc369cab tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:50 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.info Sep 06 08:24:50 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:50 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f7eb7835-a461-4b02-ab10-47a6bc369cab tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.info" returned: 0 in 0.259s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:50 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f7eb7835-a461-4b02-ab10-47a6bc369cab tempest-ProjectMemberTests-219511464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.389s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:50 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f7eb7835-a461-4b02-ab10-47a6bc369cab tempest-ProjectMemberTests-219511464 None] Create snapshot completed successfully Sep 06 08:24:51 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-444f813d-37d8-499a-b8c9-7d00381773f3 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-865a6c83-23cd-4df9-ae50-3a9156ba41ad-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:51 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-444f813d-37d8-499a-b8c9-7d00381773f3 tempest-ProjectMemberTests-219511464 None] Lock "cinder-865a6c83-23cd-4df9-ae50-3a9156ba41ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:51 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-444f813d-37d8-499a-b8c9-7d00381773f3 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-c15e5fd4-047f-4d68-aef4-03dca28fa83a" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:51 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-444f813d-37d8-499a-b8c9-7d00381773f3 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-c15e5fd4-047f-4d68-aef4-03dca28fa83a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:51 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-444f813d-37d8-499a-b8c9-7d00381773f3 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-865a6c83-23cd-4df9-ae50-3a9156ba41ad" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:51 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-444f813d-37d8-499a-b8c9-7d00381773f3 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-865a6c83-23cd-4df9-ae50-3a9156ba41ad" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-444f813d-37d8-499a-b8c9-7d00381773f3 tempest-ProjectMemberTests-219511464 None] Deleting offline snapshot 865a6c83-23cd-4df9-ae50-3a9156ba41ad of volume c15e5fd4-047f-4d68-aef4-03dca28fa83a {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:24:51 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-444f813d-37d8-499a-b8c9-7d00381773f3 tempest-ProjectMemberTests-219511464 None] snapshot_file for this snap is: volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.865a6c83-23cd-4df9-ae50-3a9156ba41ad {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:24:51 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1a6b02-39b1-4dc8-9205-32135addac98]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:51 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-444f813d-37d8-499a-b8c9-7d00381773f3 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.865a6c83-23cd-4df9-ae50-3a9156ba41ad {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:51 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.865a6c83-23cd-4df9-ae50-3a9156ba41ad Sep 06 08:24:51 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:52 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-444f813d-37d8-499a-b8c9-7d00381773f3 tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.865a6c83-23cd-4df9-ae50-3a9156ba41ad" returned: 0 in 0.440s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:52 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-444f813d-37d8-499a-b8c9-7d00381773f3 tempest-ProjectMemberTests-219511464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:24:52 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fa4761-8cb6-4a4f-979a-da78650a9fd0]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-444f813d-37d8-499a-b8c9-7d00381773f3 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:52 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a Sep 06 08:24:52 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:52 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-444f813d-37d8-499a-b8c9-7d00381773f3 tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a" returned: 0 in 0.349s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-444f813d-37d8-499a-b8c9-7d00381773f3 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.865a6c83-23cd-4df9-ae50-3a9156ba41ad {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:52 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.865a6c83-23cd-4df9-ae50-3a9156ba41ad Sep 06 08:24:52 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:52 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-444f813d-37d8-499a-b8c9-7d00381773f3 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.865a6c83-23cd-4df9-ae50-3a9156ba41ad" returned: 0 in 0.423s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:52 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-444f813d-37d8-499a-b8c9-7d00381773f3 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.865a6c83-23cd-4df9-ae50-3a9156ba41ad {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:52 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.865a6c83-23cd-4df9-ae50-3a9156ba41ad Sep 06 08:24:52 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:53 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-444f813d-37d8-499a-b8c9-7d00381773f3 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a.865a6c83-23cd-4df9-ae50-3a9156ba41ad" returned: 0 in 0.305s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-444f813d-37d8-499a-b8c9-7d00381773f3 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-865a6c83-23cd-4df9-ae50-3a9156ba41ad" released by "_delete_snapshot" :: held 1.634s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-444f813d-37d8-499a-b8c9-7d00381773f3 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-c15e5fd4-047f-4d68-aef4-03dca28fa83a" released by "delete_snapshot" :: held 1.661s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:53 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-444f813d-37d8-499a-b8c9-7d00381773f3 tempest-ProjectMemberTests-219511464 None] Created reservations ['e80fa9aa-501f-419b-aeb1-d8cb5e3d2e7b', 'd9935c7a-2c43-4c58-901a-c133fc3c1069', '3c7db475-4e81-45aa-979e-3053b436be89', '01479be6-9ada-4a28-b22a-5c127ade02c4'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:53 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-444f813d-37d8-499a-b8c9-7d00381773f3 tempest-ProjectMemberTests-219511464 None] Delete snapshot completed successfully. Sep 06 08:24:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-444f813d-37d8-499a-b8c9-7d00381773f3 tempest-ProjectMemberTests-219511464 None] Lock "cinder-865a6c83-23cd-4df9-ae50-3a9156ba41ad-delete_snapshot" released by "delete_snapshot" :: held 1.861s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6ca0d241-4884-442b-b3e9-fbf9c597d82f tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-c15e5fd4-047f-4d68-aef4-03dca28fa83a-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6ca0d241-4884-442b-b3e9-fbf9c597d82f tempest-ProjectMemberTests-219511464 None] Lock "cinder-c15e5fd4-047f-4d68-aef4-03dca28fa83a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6ca0d241-4884-442b-b3e9-fbf9c597d82f tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-c15e5fd4-047f-4d68-aef4-03dca28fa83a" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:24:53 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6ca0d241-4884-442b-b3e9-fbf9c597d82f tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-c15e5fd4-047f-4d68-aef4-03dca28fa83a" acquired by "delete_volume" :: waited 0.052s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:24:53 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0b8264-0562-4ab0-aded-dd33d082d181]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:53 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6ca0d241-4884-442b-b3e9-fbf9c597d82f tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:54 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a Sep 06 08:24:54 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:54 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6ca0d241-4884-442b-b3e9-fbf9c597d82f tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a" returned: 0 in 0.476s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6ca0d241-4884-442b-b3e9-fbf9c597d82f tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:54 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a Sep 06 08:24:54 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:54 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6ca0d241-4884-442b-b3e9-fbf9c597d82f tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-c15e5fd4-047f-4d68-aef4-03dca28fa83a" returned: 0 in 0.262s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:54 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6ca0d241-4884-442b-b3e9-fbf9c597d82f tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-c15e5fd4-047f-4d68-aef4-03dca28fa83a" released by "delete_volume" :: held 0.832s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:54 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-6ca0d241-4884-442b-b3e9-fbf9c597d82f tempest-ProjectMemberTests-219511464 None] Created reservations ['d06c7143-cb6d-44f3-a63c-94f1c394f885', '5090b1eb-e6ed-48f8-8fbb-8802f2f6f419', '2655e251-9b54-4eb3-b94b-8f4896d9450d', '7bb1345a-a123-4ca2-91d1-b6fb1109b23e'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:24:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6ca0d241-4884-442b-b3e9-fbf9c597d82f tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6ca0d241-4884-442b-b3e9-fbf9c597d82f tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6ca0d241-4884-442b-b3e9-fbf9c597d82f tempest-ProjectMemberTests-219511464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:54 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6ca0d241-4884-442b-b3e9-fbf9c597d82f tempest-ProjectMemberTests-219511464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6ca0d241-4884-442b-b3e9-fbf9c597d82f tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:54 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6ca0d241-4884-442b-b3e9-fbf9c597d82f tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:54 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:24:54 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:55 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6ca0d241-4884-442b-b3e9-fbf9c597d82f tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.320s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6ca0d241-4884-442b-b3e9-fbf9c597d82f tempest-ProjectMemberTests-219511464 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:24:55 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-6ca0d241-4884-442b-b3e9-fbf9c597d82f tempest-ProjectMemberTests-219511464 None] Deleted volume successfully. Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6ca0d241-4884-442b-b3e9-fbf9c597d82f tempest-ProjectMemberTests-219511464 None] Lock "cinder-c15e5fd4-047f-4d68-aef4-03dca28fa83a-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Flow 'volume_create_manager' (1892bfc3-ac75-4ebb-a351-2698fabd1a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40177e75-2895-46e0-9565-9e7801aabf9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40177e75-2895-46e0-9565-9e7801aabf9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-50816347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f17eab40-1bd3-49f4-8ca9-be48b282842c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57ff192bd0a74a27be0be1f1201231cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:55Z,use_quota=True,user_id='0f50a8b862534662bb877ccafabde4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef85b907-3067-4027-9218-e235b3025bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef85b907-3067-4027-9218-e235b3025bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469c2f1f-0d6c-4319-8911-12733181ef06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469c2f1f-0d6c-4319-8911-12733181ef06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f17eab40-1bd3-49f4-8ca9-be48b282842c', 'volume_name': 'volume-f17eab40-1bd3-49f4-8ca9-be48b282842c', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b955b31c-64ad-4cae-98c0-878561fd4ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b955b31c-64ad-4cae-98c0-878561fd4ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (024459b6-c2a5-4732-ae6c-720e02c2d904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:55 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Volume f17eab40-1bd3-49f4-8ca9-be48b282842c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f17eab40-1bd3-49f4-8ca9-be48b282842c', 'volume_size': 1} Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-50816347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f17eab40-1bd3-49f4-8ca9-be48b282842c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57ff192bd0a74a27be0be1f1201231cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:24:55Z,use_quota=True,user_id='0f50a8b862534662bb877ccafabde4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Creating volume f17eab40-1bd3-49f4-8ca9-be48b282842c {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:24:55 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:24:55 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:55 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c 1073741824 Sep 06 08:24:55 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:56 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c 1073741824" returned: 0 in 0.542s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:56 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c Sep 06 08:24:56 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:56 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c" returned: 0 in 0.272s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:24:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (024459b6-c2a5-4732-ae6c-720e02c2d904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f17eab40-1bd3-49f4-8ca9-be48b282842c', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b574b691-ff2f-44bd-9c61-92d7a00e7497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:24:56 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Volume volume-f17eab40-1bd3-49f4-8ca9-be48b282842c (f17eab40-1bd3-49f4-8ca9-be48b282842c): created successfully Sep 06 08:24:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b574b691-ff2f-44bd-9c61-92d7a00e7497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:24:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Flow 'volume_create_manager' (1892bfc3-ac75-4ebb-a351-2698fabd1a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:24:56 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e17c1b42-b1ef-4d29-b2dc-85b05f2561c4 tempest-ProjectMemberTests-219511464 None] Created volume successfully. Sep 06 08:24:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8646194e-0e4c-474a-bb2c-267f10a823a3 tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8646194e-0e4c-474a-bb2c-267f10a823a3 tempest-ProjectMemberTests-219511464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-8646194e-0e4c-474a-bb2c-267f10a823a3 tempest-ProjectMemberTests-219511464 None] Creating offline snapshot 0222d474-e620-446a-bc02-96cbaefd36de of volume f17eab40-1bd3-49f4-8ca9-be48b282842c {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:24:57 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cdbe81-2050-4cc8-af83-14c142672395]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:24:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8646194e-0e4c-474a-bb2c-267f10a823a3 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:57 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c Sep 06 08:24:57 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:58 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8646194e-0e4c-474a-bb2c-267f10a823a3 tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c" returned: 0 in 0.377s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8646194e-0e4c-474a-bb2c-267f10a823a3 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.0222d474-e620-446a-bc02-96cbaefd36de 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:58 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.0222d474-e620-446a-bc02-96cbaefd36de 1G Sep 06 08:24:58 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:58 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8646194e-0e4c-474a-bb2c-267f10a823a3 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.0222d474-e620-446a-bc02-96cbaefd36de 1G" returned: 0 in 0.413s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8646194e-0e4c-474a-bb2c-267f10a823a3 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f17eab40-1bd3-49f4-8ca9-be48b282842c -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.0222d474-e620-446a-bc02-96cbaefd36de {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:58 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f17eab40-1bd3-49f4-8ca9-be48b282842c -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.0222d474-e620-446a-bc02-96cbaefd36de Sep 06 08:24:58 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:58 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8646194e-0e4c-474a-bb2c-267f10a823a3 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f17eab40-1bd3-49f4-8ca9-be48b282842c -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.0222d474-e620-446a-bc02-96cbaefd36de" returned: 0 in 0.303s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:58 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-8646194e-0e4c-474a-bb2c-267f10a823a3 tempest-ProjectMemberTests-219511464 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.0222d474-e620-446a-bc02-96cbaefd36de is being set with open permissions: ugo+rw Sep 06 08:24:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8646194e-0e4c-474a-bb2c-267f10a823a3 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.0222d474-e620-446a-bc02-96cbaefd36de {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:58 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.0222d474-e620-446a-bc02-96cbaefd36de Sep 06 08:24:58 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:59 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8646194e-0e4c-474a-bb2c-267f10a823a3 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.0222d474-e620-446a-bc02-96cbaefd36de" returned: 0 in 0.261s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8646194e-0e4c-474a-bb2c-267f10a823a3 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:59 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.info Sep 06 08:24:59 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:59 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8646194e-0e4c-474a-bb2c-267f10a823a3 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.info" returned: 0 in 0.260s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:59 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-8646194e-0e4c-474a-bb2c-267f10a823a3 tempest-ProjectMemberTests-219511464 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.info is being set with open permissions: ugo+rw Sep 06 08:24:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8646194e-0e4c-474a-bb2c-267f10a823a3 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:59 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.info Sep 06 08:24:59 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:59 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8646194e-0e4c-474a-bb2c-267f10a823a3 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.info" returned: 0 in 0.249s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8646194e-0e4c-474a-bb2c-267f10a823a3 tempest-ProjectMemberTests-219511464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.952s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:24:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:24:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:24:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:24:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:24:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:24:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:24:59 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:24:59 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:24:59 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-8646194e-0e4c-474a-bb2c-267f10a823a3 tempest-ProjectMemberTests-219511464 None] Create snapshot completed successfully Sep 06 08:24:59 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Sep 06 08:24:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.252s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:24:59 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:24:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager._thread_info {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:24:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread count: 28 {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 08:24:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread info: [<_MainThread(MainThread, started 139985167040640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:24:59 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-5cc9c346-1e27-4935-90f2-166e002c6afe tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-0222d474-e620-446a-bc02-96cbaefd36de-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-5cc9c346-1e27-4935-90f2-166e002c6afe tempest-ProjectMemberTests-219511464 None] Lock "cinder-0222d474-e620-446a-bc02-96cbaefd36de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-5cc9c346-1e27-4935-90f2-166e002c6afe tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-f17eab40-1bd3-49f4-8ca9-be48b282842c" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-5cc9c346-1e27-4935-90f2-166e002c6afe tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-f17eab40-1bd3-49f4-8ca9-be48b282842c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-5cc9c346-1e27-4935-90f2-166e002c6afe tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-0222d474-e620-446a-bc02-96cbaefd36de" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-5cc9c346-1e27-4935-90f2-166e002c6afe tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-0222d474-e620-446a-bc02-96cbaefd36de" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-5cc9c346-1e27-4935-90f2-166e002c6afe tempest-ProjectMemberTests-219511464 None] Deleting offline snapshot 0222d474-e620-446a-bc02-96cbaefd36de of volume f17eab40-1bd3-49f4-8ca9-be48b282842c {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:25:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-5cc9c346-1e27-4935-90f2-166e002c6afe tempest-ProjectMemberTests-219511464 None] snapshot_file for this snap is: volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.0222d474-e620-446a-bc02-96cbaefd36de {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:25:00 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1ea09a-4c4a-4c41-b04f-a7902fb21d08]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:25:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5cc9c346-1e27-4935-90f2-166e002c6afe tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.0222d474-e620-446a-bc02-96cbaefd36de {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:00 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.0222d474-e620-446a-bc02-96cbaefd36de Sep 06 08:25:00 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:00 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5cc9c346-1e27-4935-90f2-166e002c6afe tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.0222d474-e620-446a-bc02-96cbaefd36de" returned: 0 in 0.424s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-5cc9c346-1e27-4935-90f2-166e002c6afe tempest-ProjectMemberTests-219511464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f17eab40-1bd3-49f4-8ca9-be48b282842c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:25:00 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7ce6c3-9a12-4ace-bd4a-a19355f15fbf]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:25:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5cc9c346-1e27-4935-90f2-166e002c6afe tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:00 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c Sep 06 08:25:00 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:00 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5cc9c346-1e27-4935-90f2-166e002c6afe tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c" returned: 0 in 0.375s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5cc9c346-1e27-4935-90f2-166e002c6afe tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.0222d474-e620-446a-bc02-96cbaefd36de {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:00 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.0222d474-e620-446a-bc02-96cbaefd36de Sep 06 08:25:00 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:01 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5cc9c346-1e27-4935-90f2-166e002c6afe tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.0222d474-e620-446a-bc02-96cbaefd36de" returned: 0 in 0.381s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5cc9c346-1e27-4935-90f2-166e002c6afe tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.0222d474-e620-446a-bc02-96cbaefd36de {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:01 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.0222d474-e620-446a-bc02-96cbaefd36de Sep 06 08:25:01 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:01 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-5cc9c346-1e27-4935-90f2-166e002c6afe tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c.0222d474-e620-446a-bc02-96cbaefd36de" returned: 0 in 0.264s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-5cc9c346-1e27-4935-90f2-166e002c6afe tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-0222d474-e620-446a-bc02-96cbaefd36de" released by "_delete_snapshot" :: held 1.556s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-5cc9c346-1e27-4935-90f2-166e002c6afe tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-f17eab40-1bd3-49f4-8ca9-be48b282842c" released by "delete_snapshot" :: held 1.577s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:01 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-5cc9c346-1e27-4935-90f2-166e002c6afe tempest-ProjectMemberTests-219511464 None] Created reservations ['80c6cd01-b787-42ee-a08a-bdb51c3eb039', 'b567722c-2829-429f-bef8-6d2acad7fe82', '2d0e4156-95fb-413f-8594-b0149e11adde', 'a8b8d0dc-03af-4ecc-895d-2241e983567e'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:25:01 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-5cc9c346-1e27-4935-90f2-166e002c6afe tempest-ProjectMemberTests-219511464 None] Delete snapshot completed successfully. Sep 06 08:25:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-5cc9c346-1e27-4935-90f2-166e002c6afe tempest-ProjectMemberTests-219511464 None] Lock "cinder-0222d474-e620-446a-bc02-96cbaefd36de-delete_snapshot" released by "delete_snapshot" :: held 1.740s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f5f9f843-73e4-48d6-9f50-d6aaa6835653 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-f17eab40-1bd3-49f4-8ca9-be48b282842c-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f5f9f843-73e4-48d6-9f50-d6aaa6835653 tempest-ProjectMemberTests-219511464 None] Lock "cinder-f17eab40-1bd3-49f4-8ca9-be48b282842c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f5f9f843-73e4-48d6-9f50-d6aaa6835653 tempest-ProjectMemberTests-219511464 None] Acquiring lock "cinder-quobyte-f17eab40-1bd3-49f4-8ca9-be48b282842c" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f5f9f843-73e4-48d6-9f50-d6aaa6835653 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-f17eab40-1bd3-49f4-8ca9-be48b282842c" acquired by "delete_volume" :: waited 0.021s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:02 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[120dc428-4ca2-4212-b7e9-4eaf6017b58b]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:25:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f5f9f843-73e4-48d6-9f50-d6aaa6835653 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:02 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c Sep 06 08:25:02 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:02 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f5f9f843-73e4-48d6-9f50-d6aaa6835653 tempest-ProjectMemberTests-219511464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c" returned: 0 in 0.351s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f5f9f843-73e4-48d6-9f50-d6aaa6835653 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:02 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c Sep 06 08:25:02 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:02 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f5f9f843-73e4-48d6-9f50-d6aaa6835653 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-f17eab40-1bd3-49f4-8ca9-be48b282842c" returned: 0 in 0.246s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f5f9f843-73e4-48d6-9f50-d6aaa6835653 tempest-ProjectMemberTests-219511464 None] Lock "cinder-quobyte-f17eab40-1bd3-49f4-8ca9-be48b282842c" released by "delete_volume" :: held 0.656s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:02 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-f5f9f843-73e4-48d6-9f50-d6aaa6835653 tempest-ProjectMemberTests-219511464 None] Created reservations ['9ae698c5-1b1a-4c40-a900-27c3deef5ab3', '5172713e-2eb7-4fa9-8309-c80567a50e69', '54fd163d-c5f6-40e3-8314-524228a3d001', 'df71bb21-269b-4981-a8cb-1da165e5bbee'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:25:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f5f9f843-73e4-48d6-9f50-d6aaa6835653 tempest-ProjectMemberTests-219511464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f5f9f843-73e4-48d6-9f50-d6aaa6835653 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:03 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f5f9f843-73e4-48d6-9f50-d6aaa6835653 tempest-ProjectMemberTests-219511464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:25:03 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f5f9f843-73e4-48d6-9f50-d6aaa6835653 tempest-ProjectMemberTests-219511464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:25:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f5f9f843-73e4-48d6-9f50-d6aaa6835653 tempest-ProjectMemberTests-219511464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f5f9f843-73e4-48d6-9f50-d6aaa6835653 tempest-ProjectMemberTests-219511464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:03 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:25:03 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:03 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f5f9f843-73e4-48d6-9f50-d6aaa6835653 tempest-ProjectMemberTests-219511464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.247s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:03 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-f5f9f843-73e4-48d6-9f50-d6aaa6835653 tempest-ProjectMemberTests-219511464 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:25:03 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f5f9f843-73e4-48d6-9f50-d6aaa6835653 tempest-ProjectMemberTests-219511464 None] Deleted volume successfully. Sep 06 08:25:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f5f9f843-73e4-48d6-9f50-d6aaa6835653 tempest-ProjectMemberTests-219511464 None] Lock "cinder-f17eab40-1bd3-49f4-8ca9-be48b282842c-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:06 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:25:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Flow 'volume_create_manager' (66cac0c2-fee6-403c-b02f-8f00d02cdc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:25:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da96618-ae48-4c39-804a-2600bdecfc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da96618-ae48-4c39-804a-2600bdecfc53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1252753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983b4441d7994f128020eab6b42b1997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:25:07Z,use_quota=True,user_id='72c02a206c014afeb3122237bf4bdfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe476b13-29d0-4ce1-9e71-2b4a46fd8f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe476b13-29d0-4ce1-9e71-2b4a46fd8f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab8d09da-c910-4f05-97fd-bc337dd89265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab8d09da-c910-4f05-97fd-bc337dd89265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024', 'volume_name': 'volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4845d9d6-c87d-4ed0-92b6-a28ad6b4588b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4845d9d6-c87d-4ed0-92b6-a28ad6b4588b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:06 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (683834a3-998f-4dbc-a456-f5d18eb5b92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:06 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Volume ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024', 'volume_size': 1} Sep 06 08:25:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1252753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983b4441d7994f128020eab6b42b1997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:25:07Z,use_quota=True,user_id='72c02a206c014afeb3122237bf4bdfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:25:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Creating volume ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:25:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:25:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:25:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:25:06 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:25:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:06 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024 1073741824 Sep 06 08:25:06 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:07 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024 1073741824" returned: 0 in 0.416s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:07 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:UPDATE=191,cinder:SELECT=140,cinder:INSERT=50,cinder:DELETE=13 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:25:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:07 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024 Sep 06 08:25:07 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:07 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024" returned: 0 in 0.238s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:25:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (683834a3-998f-4dbc-a456-f5d18eb5b92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9510ecc-dec7-49c7-a352-22d4fdeb614d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:07 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=146,cinder:INSERT=50,cinder:UPDATE=199,cinder:DELETE=20 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:25:07 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Volume volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024 (ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024): created successfully Sep 06 08:25:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9510ecc-dec7-49c7-a352-22d4fdeb614d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:07 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Flow 'volume_create_manager' (66cac0c2-fee6-403c-b02f-8f00d02cdc6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:25:07 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e381357f-2dec-41c6-8e58-d08bd00bd5e0 tempest-ProjectReaderTests-1980438739 None] Created volume successfully. Sep 06 08:25:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2f1288e7-c81a-4835-9640-652e197f1f40 tempest-ProjectReaderTests-1980438739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2f1288e7-c81a-4835-9640-652e197f1f40 tempest-ProjectReaderTests-1980438739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:07 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-2f1288e7-c81a-4835-9640-652e197f1f40 tempest-ProjectReaderTests-1980438739 None] Creating offline snapshot fcdbe728-fde5-4868-9dbe-0abf3a04a343 of volume ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:25:07 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb47e61-6704-47cc-9b19-cd43c0a7d2d6]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:25:07 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2f1288e7-c81a-4835-9640-652e197f1f40 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:08 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024 Sep 06 08:25:08 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:08 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2f1288e7-c81a-4835-9640-652e197f1f40 tempest-ProjectReaderTests-1980438739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024" returned: 0 in 0.360s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2f1288e7-c81a-4835-9640-652e197f1f40 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.fcdbe728-fde5-4868-9dbe-0abf3a04a343 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:08 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.fcdbe728-fde5-4868-9dbe-0abf3a04a343 1G Sep 06 08:25:08 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:08 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2f1288e7-c81a-4835-9640-652e197f1f40 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.fcdbe728-fde5-4868-9dbe-0abf3a04a343 1G" returned: 0 in 0.381s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2f1288e7-c81a-4835-9640-652e197f1f40 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.fcdbe728-fde5-4868-9dbe-0abf3a04a343 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:08 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.fcdbe728-fde5-4868-9dbe-0abf3a04a343 Sep 06 08:25:08 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:08 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2f1288e7-c81a-4835-9640-652e197f1f40 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.fcdbe728-fde5-4868-9dbe-0abf3a04a343" returned: 0 in 0.290s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:08 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-2f1288e7-c81a-4835-9640-652e197f1f40 tempest-ProjectReaderTests-1980438739 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.fcdbe728-fde5-4868-9dbe-0abf3a04a343 is being set with open permissions: ugo+rw Sep 06 08:25:08 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2f1288e7-c81a-4835-9640-652e197f1f40 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.fcdbe728-fde5-4868-9dbe-0abf3a04a343 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:08 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.fcdbe728-fde5-4868-9dbe-0abf3a04a343 Sep 06 08:25:08 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:09 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2f1288e7-c81a-4835-9640-652e197f1f40 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.fcdbe728-fde5-4868-9dbe-0abf3a04a343" returned: 0 in 0.242s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2f1288e7-c81a-4835-9640-652e197f1f40 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:09 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.info Sep 06 08:25:09 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:09 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2f1288e7-c81a-4835-9640-652e197f1f40 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.info" returned: 0 in 0.238s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:09 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-2f1288e7-c81a-4835-9640-652e197f1f40 tempest-ProjectReaderTests-1980438739 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.info is being set with open permissions: ugo+rw Sep 06 08:25:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2f1288e7-c81a-4835-9640-652e197f1f40 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:09 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.info Sep 06 08:25:09 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:09 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2f1288e7-c81a-4835-9640-652e197f1f40 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.info" returned: 0 in 0.244s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:09 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2f1288e7-c81a-4835-9640-652e197f1f40 tempest-ProjectReaderTests-1980438739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.833s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:09 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-2f1288e7-c81a-4835-9640-652e197f1f40 tempest-ProjectReaderTests-1980438739 None] Create snapshot completed successfully Sep 06 08:25:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e980aaed-bab8-4c93-b994-31c1df0ed11e tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-fcdbe728-fde5-4868-9dbe-0abf3a04a343-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e980aaed-bab8-4c93-b994-31c1df0ed11e tempest-ProjectReaderTests-1980438739 None] Lock "cinder-fcdbe728-fde5-4868-9dbe-0abf3a04a343-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e980aaed-bab8-4c93-b994-31c1df0ed11e tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-quobyte-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e980aaed-bab8-4c93-b994-31c1df0ed11e tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e980aaed-bab8-4c93-b994-31c1df0ed11e tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-quobyte-fcdbe728-fde5-4868-9dbe-0abf3a04a343" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:10 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e980aaed-bab8-4c93-b994-31c1df0ed11e tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-fcdbe728-fde5-4868-9dbe-0abf3a04a343" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-e980aaed-bab8-4c93-b994-31c1df0ed11e tempest-ProjectReaderTests-1980438739 None] Deleting offline snapshot fcdbe728-fde5-4868-9dbe-0abf3a04a343 of volume ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:25:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-e980aaed-bab8-4c93-b994-31c1df0ed11e tempest-ProjectReaderTests-1980438739 None] snapshot_file for this snap is: volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.fcdbe728-fde5-4868-9dbe-0abf3a04a343 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:25:10 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a134137d-f0ed-48d0-9313-2115da582373]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:25:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e980aaed-bab8-4c93-b994-31c1df0ed11e tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.fcdbe728-fde5-4868-9dbe-0abf3a04a343 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:10 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.fcdbe728-fde5-4868-9dbe-0abf3a04a343 Sep 06 08:25:10 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:10 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e980aaed-bab8-4c93-b994-31c1df0ed11e tempest-ProjectReaderTests-1980438739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.fcdbe728-fde5-4868-9dbe-0abf3a04a343" returned: 0 in 0.380s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:10 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-e980aaed-bab8-4c93-b994-31c1df0ed11e tempest-ProjectReaderTests-1980438739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:25:10 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b7dac0-1033-4f79-adae-8b12864e78de]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:25:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e980aaed-bab8-4c93-b994-31c1df0ed11e tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:10 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024 Sep 06 08:25:10 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:10 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e980aaed-bab8-4c93-b994-31c1df0ed11e tempest-ProjectReaderTests-1980438739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024" returned: 0 in 0.349s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:10 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e980aaed-bab8-4c93-b994-31c1df0ed11e tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.fcdbe728-fde5-4868-9dbe-0abf3a04a343 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:10 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.fcdbe728-fde5-4868-9dbe-0abf3a04a343 Sep 06 08:25:10 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:11 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e980aaed-bab8-4c93-b994-31c1df0ed11e tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.fcdbe728-fde5-4868-9dbe-0abf3a04a343" returned: 0 in 0.334s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e980aaed-bab8-4c93-b994-31c1df0ed11e tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.fcdbe728-fde5-4868-9dbe-0abf3a04a343 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:11 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.fcdbe728-fde5-4868-9dbe-0abf3a04a343 Sep 06 08:25:11 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:11 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:11 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-e980aaed-bab8-4c93-b994-31c1df0ed11e tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024.fcdbe728-fde5-4868-9dbe-0abf3a04a343" returned: 0 in 0.244s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:11 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e980aaed-bab8-4c93-b994-31c1df0ed11e tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-fcdbe728-fde5-4868-9dbe-0abf3a04a343" released by "_delete_snapshot" :: held 1.390s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:11 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e980aaed-bab8-4c93-b994-31c1df0ed11e tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024" released by "delete_snapshot" :: held 1.412s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:11 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-e980aaed-bab8-4c93-b994-31c1df0ed11e tempest-ProjectReaderTests-1980438739 None] Created reservations ['5e2dd8dc-37e6-428c-801a-d1bd0d86141a', 'd82e7d42-d982-4393-a4e8-42078cce79ce', '06952590-8f63-4d96-90a3-ceb001222aba', 'afa7ad29-b4bb-47b5-be13-efd7a92a672c'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:25:11 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-e980aaed-bab8-4c93-b994-31c1df0ed11e tempest-ProjectReaderTests-1980438739 None] Delete snapshot completed successfully. Sep 06 08:25:11 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-e980aaed-bab8-4c93-b994-31c1df0ed11e tempest-ProjectReaderTests-1980438739 None] Lock "cinder-fcdbe728-fde5-4868-9dbe-0abf3a04a343-delete_snapshot" released by "delete_snapshot" :: held 1.544s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:12 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-fdd9bb6e-ba05-460f-a8c7-94a8eb47a63e tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:12 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-fdd9bb6e-ba05-460f-a8c7-94a8eb47a63e tempest-ProjectReaderTests-1980438739 None] Lock "cinder-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:12 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-fdd9bb6e-ba05-460f-a8c7-94a8eb47a63e tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-quobyte-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:12 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-fdd9bb6e-ba05-460f-a8c7-94a8eb47a63e tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024" acquired by "delete_volume" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:12 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd07047b-ca90-454d-b586-c310cbb2bb6e]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:25:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-fdd9bb6e-ba05-460f-a8c7-94a8eb47a63e tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:12 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024 Sep 06 08:25:12 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:12 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-fdd9bb6e-ba05-460f-a8c7-94a8eb47a63e tempest-ProjectReaderTests-1980438739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024" returned: 0 in 0.349s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:12 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-fdd9bb6e-ba05-460f-a8c7-94a8eb47a63e tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:12 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024 Sep 06 08:25:12 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:13 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-fdd9bb6e-ba05-460f-a8c7-94a8eb47a63e tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024" returned: 0 in 0.239s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-fdd9bb6e-ba05-460f-a8c7-94a8eb47a63e tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024" released by "delete_volume" :: held 0.641s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-fdd9bb6e-ba05-460f-a8c7-94a8eb47a63e tempest-ProjectReaderTests-1980438739 None] Created reservations ['93ceb625-1bda-45ea-a0a3-308ee4e971cd', '91342d5d-1496-467d-8ec2-e23d173ed616', '1923a1aa-ffad-4e0a-9f4c-813aa0df0885', '7a321e39-7b46-4902-80da-6031692ec2a5'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-fdd9bb6e-ba05-460f-a8c7-94a8eb47a63e tempest-ProjectReaderTests-1980438739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-fdd9bb6e-ba05-460f-a8c7-94a8eb47a63e tempest-ProjectReaderTests-1980438739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-fdd9bb6e-ba05-460f-a8c7-94a8eb47a63e tempest-ProjectReaderTests-1980438739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-fdd9bb6e-ba05-460f-a8c7-94a8eb47a63e tempest-ProjectReaderTests-1980438739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-fdd9bb6e-ba05-460f-a8c7-94a8eb47a63e tempest-ProjectReaderTests-1980438739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-fdd9bb6e-ba05-460f-a8c7-94a8eb47a63e tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:13 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:25:13 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:13 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-fdd9bb6e-ba05-460f-a8c7-94a8eb47a63e tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.242s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-fdd9bb6e-ba05-460f-a8c7-94a8eb47a63e tempest-ProjectReaderTests-1980438739 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:25:13 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-fdd9bb6e-ba05-460f-a8c7-94a8eb47a63e tempest-ProjectReaderTests-1980438739 None] Deleted volume successfully. Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-fdd9bb6e-ba05-460f-a8c7-94a8eb47a63e tempest-ProjectReaderTests-1980438739 None] Lock "cinder-ebb75b91-b4ef-4abd-bf18-d1fd8d7ef024-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Flow 'volume_create_manager' (3d4bccb7-ac86-4127-8102-3fbb9b183cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ef8fbc-7156-43d9-b907-8e4509e22fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ef8fbc-7156-43d9-b907-8e4509e22fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-63876488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e10e028-21e3-46d4-8b1e-f70b8a430cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983b4441d7994f128020eab6b42b1997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:25:14Z,use_quota=True,user_id='72c02a206c014afeb3122237bf4bdfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08fcfa4f-76b5-4d82-afa7-3bb7d95c8a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08fcfa4f-76b5-4d82-afa7-3bb7d95c8a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827eed9e-7680-49fb-a167-70dc85673b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827eed9e-7680-49fb-a167-70dc85673b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e10e028-21e3-46d4-8b1e-f70b8a430cf7', 'volume_name': 'volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da7f1ca2-2f1f-4b26-9b81-67ce35e26457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da7f1ca2-2f1f-4b26-9b81-67ce35e26457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560acc89-a0fc-4e01-89e6-4c781c43dc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:13 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Volume 7e10e028-21e3-46d4-8b1e-f70b8a430cf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7', 'volume_size': 1} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-63876488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e10e028-21e3-46d4-8b1e-f70b8a430cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983b4441d7994f128020eab6b42b1997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:25:14Z,use_quota=True,user_id='72c02a206c014afeb3122237bf4bdfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Creating volume 7e10e028-21e3-46d4-8b1e-f70b8a430cf7 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:25:13 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:25:13 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:13 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7 1073741824 Sep 06 08:25:13 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:14 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7 1073741824" returned: 0 in 0.401s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:14 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7 Sep 06 08:25:14 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:14 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7" returned: 0 in 0.242s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:14 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:25:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560acc89-a0fc-4e01-89e6-4c781c43dc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bde61f6-b3fb-45b6-bd79-46bb0b12cb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:14 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Volume volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7 (7e10e028-21e3-46d4-8b1e-f70b8a430cf7): created successfully Sep 06 08:25:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bde61f6-b3fb-45b6-bd79-46bb0b12cb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:14 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Flow 'volume_create_manager' (3d4bccb7-ac86-4127-8102-3fbb9b183cc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:25:14 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-29d3b42a-71e4-426a-bca2-345c064c4019 tempest-ProjectReaderTests-1980438739 None] Created volume successfully. Sep 06 08:25:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-46cff54d-f79d-4577-a770-74824dbb49a3 tempest-ProjectReaderTests-1980438739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:14 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-46cff54d-f79d-4577-a770-74824dbb49a3 tempest-ProjectReaderTests-1980438739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:15 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-46cff54d-f79d-4577-a770-74824dbb49a3 tempest-ProjectReaderTests-1980438739 None] Creating offline snapshot b418a878-f7d0-4682-be46-9a921cf336c6 of volume 7e10e028-21e3-46d4-8b1e-f70b8a430cf7 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:25:15 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdce2bb-ebba-422c-a8ae-85b2cd4d53d6]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:25:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-46cff54d-f79d-4577-a770-74824dbb49a3 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:15 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7 Sep 06 08:25:15 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:15 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-46cff54d-f79d-4577-a770-74824dbb49a3 tempest-ProjectReaderTests-1980438739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7" returned: 0 in 0.345s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-46cff54d-f79d-4577-a770-74824dbb49a3 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.b418a878-f7d0-4682-be46-9a921cf336c6 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:15 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.b418a878-f7d0-4682-be46-9a921cf336c6 1G Sep 06 08:25:15 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:15 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-46cff54d-f79d-4577-a770-74824dbb49a3 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.b418a878-f7d0-4682-be46-9a921cf336c6 1G" returned: 0 in 0.365s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:15 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-46cff54d-f79d-4577-a770-74824dbb49a3 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.b418a878-f7d0-4682-be46-9a921cf336c6 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:15 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.b418a878-f7d0-4682-be46-9a921cf336c6 Sep 06 08:25:15 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:16 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-46cff54d-f79d-4577-a770-74824dbb49a3 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.b418a878-f7d0-4682-be46-9a921cf336c6" returned: 0 in 0.284s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:16 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-46cff54d-f79d-4577-a770-74824dbb49a3 tempest-ProjectReaderTests-1980438739 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.b418a878-f7d0-4682-be46-9a921cf336c6 is being set with open permissions: ugo+rw Sep 06 08:25:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-46cff54d-f79d-4577-a770-74824dbb49a3 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.b418a878-f7d0-4682-be46-9a921cf336c6 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:16 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.b418a878-f7d0-4682-be46-9a921cf336c6 Sep 06 08:25:16 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:16 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-46cff54d-f79d-4577-a770-74824dbb49a3 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.b418a878-f7d0-4682-be46-9a921cf336c6" returned: 0 in 0.244s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-46cff54d-f79d-4577-a770-74824dbb49a3 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:16 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.info Sep 06 08:25:16 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:16 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-46cff54d-f79d-4577-a770-74824dbb49a3 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.info" returned: 0 in 0.236s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:16 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-46cff54d-f79d-4577-a770-74824dbb49a3 tempest-ProjectReaderTests-1980438739 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.info is being set with open permissions: ugo+rw Sep 06 08:25:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-46cff54d-f79d-4577-a770-74824dbb49a3 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:16 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.info Sep 06 08:25:16 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:16 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-46cff54d-f79d-4577-a770-74824dbb49a3 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.info" returned: 0 in 0.229s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:16 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-46cff54d-f79d-4577-a770-74824dbb49a3 tempest-ProjectReaderTests-1980438739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.773s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:16 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-46cff54d-f79d-4577-a770-74824dbb49a3 tempest-ProjectReaderTests-1980438739 None] Create snapshot completed successfully Sep 06 08:25:17 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-396b848d-3647-4b52-a756-abeaca76028b tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-b418a878-f7d0-4682-be46-9a921cf336c6-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:17 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-396b848d-3647-4b52-a756-abeaca76028b tempest-ProjectReaderTests-1980438739 None] Lock "cinder-b418a878-f7d0-4682-be46-9a921cf336c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:17 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-396b848d-3647-4b52-a756-abeaca76028b tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-quobyte-7e10e028-21e3-46d4-8b1e-f70b8a430cf7" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:17 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-396b848d-3647-4b52-a756-abeaca76028b tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-7e10e028-21e3-46d4-8b1e-f70b8a430cf7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:17 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-396b848d-3647-4b52-a756-abeaca76028b tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-quobyte-b418a878-f7d0-4682-be46-9a921cf336c6" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:17 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-396b848d-3647-4b52-a756-abeaca76028b tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-b418a878-f7d0-4682-be46-9a921cf336c6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-396b848d-3647-4b52-a756-abeaca76028b tempest-ProjectReaderTests-1980438739 None] Deleting offline snapshot b418a878-f7d0-4682-be46-9a921cf336c6 of volume 7e10e028-21e3-46d4-8b1e-f70b8a430cf7 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:25:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-396b848d-3647-4b52-a756-abeaca76028b tempest-ProjectReaderTests-1980438739 None] snapshot_file for this snap is: volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.b418a878-f7d0-4682-be46-9a921cf336c6 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:25:17 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[160d727e-40e6-4324-9b0d-6fa0f2b5f638]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:25:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-396b848d-3647-4b52-a756-abeaca76028b tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.b418a878-f7d0-4682-be46-9a921cf336c6 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:17 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.b418a878-f7d0-4682-be46-9a921cf336c6 Sep 06 08:25:17 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:17 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-396b848d-3647-4b52-a756-abeaca76028b tempest-ProjectReaderTests-1980438739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.b418a878-f7d0-4682-be46-9a921cf336c6" returned: 0 in 0.363s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:17 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-396b848d-3647-4b52-a756-abeaca76028b tempest-ProjectReaderTests-1980438739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:25:17 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[84928e08-89f2-4fdb-82ba-e56ff0aeea70]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:25:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-396b848d-3647-4b52-a756-abeaca76028b tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:17 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7 Sep 06 08:25:17 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:17 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-396b848d-3647-4b52-a756-abeaca76028b tempest-ProjectReaderTests-1980438739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7" returned: 0 in 0.359s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:17 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-396b848d-3647-4b52-a756-abeaca76028b tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.b418a878-f7d0-4682-be46-9a921cf336c6 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:17 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.b418a878-f7d0-4682-be46-9a921cf336c6 Sep 06 08:25:17 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:18 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-396b848d-3647-4b52-a756-abeaca76028b tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.b418a878-f7d0-4682-be46-9a921cf336c6" returned: 0 in 0.328s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-396b848d-3647-4b52-a756-abeaca76028b tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.b418a878-f7d0-4682-be46-9a921cf336c6 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:18 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.b418a878-f7d0-4682-be46-9a921cf336c6 Sep 06 08:25:18 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:18 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:18 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-396b848d-3647-4b52-a756-abeaca76028b tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7.b418a878-f7d0-4682-be46-9a921cf336c6" returned: 0 in 0.248s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:18 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-396b848d-3647-4b52-a756-abeaca76028b tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-b418a878-f7d0-4682-be46-9a921cf336c6" released by "_delete_snapshot" :: held 1.384s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:18 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-396b848d-3647-4b52-a756-abeaca76028b tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-7e10e028-21e3-46d4-8b1e-f70b8a430cf7" released by "delete_snapshot" :: held 1.407s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:18 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-396b848d-3647-4b52-a756-abeaca76028b tempest-ProjectReaderTests-1980438739 None] Created reservations ['4a7896e7-0398-492b-a789-f262a8cf4ffc', '38ed0126-b31e-45fe-9de9-0ef94407a401', 'b4e1fe79-9742-4e2b-b278-b3fd2671ccd7', 'a1064b3d-1148-4e07-b6a1-31dfcd1d6c05'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:25:18 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-396b848d-3647-4b52-a756-abeaca76028b tempest-ProjectReaderTests-1980438739 None] Delete snapshot completed successfully. Sep 06 08:25:18 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-396b848d-3647-4b52-a756-abeaca76028b tempest-ProjectReaderTests-1980438739 None] Lock "cinder-b418a878-f7d0-4682-be46-9a921cf336c6-delete_snapshot" released by "delete_snapshot" :: held 1.535s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:19 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3c6c7ac1-a804-4223-a468-d68d2feeb489 tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-7e10e028-21e3-46d4-8b1e-f70b8a430cf7-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:19 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3c6c7ac1-a804-4223-a468-d68d2feeb489 tempest-ProjectReaderTests-1980438739 None] Lock "cinder-7e10e028-21e3-46d4-8b1e-f70b8a430cf7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:19 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3c6c7ac1-a804-4223-a468-d68d2feeb489 tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-quobyte-7e10e028-21e3-46d4-8b1e-f70b8a430cf7" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:19 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3c6c7ac1-a804-4223-a468-d68d2feeb489 tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-7e10e028-21e3-46d4-8b1e-f70b8a430cf7" acquired by "delete_volume" :: waited 0.016s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:19 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[382df066-9ee4-4ea8-b80d-716318cb9eaa]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:25:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3c6c7ac1-a804-4223-a468-d68d2feeb489 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:19 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7 Sep 06 08:25:19 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:19 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3c6c7ac1-a804-4223-a468-d68d2feeb489 tempest-ProjectReaderTests-1980438739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7" returned: 0 in 0.360s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3c6c7ac1-a804-4223-a468-d68d2feeb489 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:19 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7 Sep 06 08:25:19 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:19 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:19 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3c6c7ac1-a804-4223-a468-d68d2feeb489 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-7e10e028-21e3-46d4-8b1e-f70b8a430cf7" returned: 0 in 0.245s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:19 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3c6c7ac1-a804-4223-a468-d68d2feeb489 tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-7e10e028-21e3-46d4-8b1e-f70b8a430cf7" released by "delete_volume" :: held 0.656s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-3c6c7ac1-a804-4223-a468-d68d2feeb489 tempest-ProjectReaderTests-1980438739 None] Created reservations ['cedb3446-0aa7-4f41-8c0b-23e805dc5c65', '60c776c0-9813-4c59-93c8-36191482ec33', '33edfbc4-d8a7-4369-a2ab-f1e4ae171cb2', '0b164c06-5a9e-4fa3-9771-863c19711fbd'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3c6c7ac1-a804-4223-a468-d68d2feeb489 tempest-ProjectReaderTests-1980438739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3c6c7ac1-a804-4223-a468-d68d2feeb489 tempest-ProjectReaderTests-1980438739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3c6c7ac1-a804-4223-a468-d68d2feeb489 tempest-ProjectReaderTests-1980438739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3c6c7ac1-a804-4223-a468-d68d2feeb489 tempest-ProjectReaderTests-1980438739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3c6c7ac1-a804-4223-a468-d68d2feeb489 tempest-ProjectReaderTests-1980438739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3c6c7ac1-a804-4223-a468-d68d2feeb489 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:20 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:25:20 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:20 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3c6c7ac1-a804-4223-a468-d68d2feeb489 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.244s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-3c6c7ac1-a804-4223-a468-d68d2feeb489 tempest-ProjectReaderTests-1980438739 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:25:20 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-3c6c7ac1-a804-4223-a468-d68d2feeb489 tempest-ProjectReaderTests-1980438739 None] Deleted volume successfully. Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-3c6c7ac1-a804-4223-a468-d68d2feeb489 tempest-ProjectReaderTests-1980438739 None] Lock "cinder-7e10e028-21e3-46d4-8b1e-f70b8a430cf7-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Flow 'volume_create_manager' (e3cc48eb-cd6d-4c78-8838-2d397990ecd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbbfb93e-b4a3-4b7f-98e5-a294bb7f2cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbbfb93e-b4a3-4b7f-98e5-a294bb7f2cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1331111966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc21333-3bce-4df1-a669-e6b01eb7ab2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983b4441d7994f128020eab6b42b1997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:25:21Z,use_quota=True,user_id='72c02a206c014afeb3122237bf4bdfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f5b004-a8e5-468a-8f6c-9db0b1c4855a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f5b004-a8e5-468a-8f6c-9db0b1c4855a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaae316f-b451-40b8-b065-ee47af9faee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaae316f-b451-40b8-b065-ee47af9faee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cc21333-3bce-4df1-a669-e6b01eb7ab2d', 'volume_name': 'volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8f4efd-2eaf-4197-bd84-257d2451872e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8f4efd-2eaf-4197-bd84-257d2451872e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8543576f-9067-4ea6-81eb-b41d29761af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:20 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Volume 6cc21333-3bce-4df1-a669-e6b01eb7ab2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d', 'volume_size': 1} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1331111966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc21333-3bce-4df1-a669-e6b01eb7ab2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983b4441d7994f128020eab6b42b1997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:25:21Z,use_quota=True,user_id='72c02a206c014afeb3122237bf4bdfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Creating volume 6cc21333-3bce-4df1-a669-e6b01eb7ab2d {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:25:20 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:25:20 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:20 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d 1073741824 Sep 06 08:25:20 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:21 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d 1073741824" returned: 0 in 0.413s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:21 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d Sep 06 08:25:21 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:21 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d" returned: 0 in 0.235s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:21 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:25:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8543576f-9067-4ea6-81eb-b41d29761af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c66b0fc6-5668-4987-afa6-ad8362e19b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:21 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Volume volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d (6cc21333-3bce-4df1-a669-e6b01eb7ab2d): created successfully Sep 06 08:25:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c66b0fc6-5668-4987-afa6-ad8362e19b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:21 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Flow 'volume_create_manager' (e3cc48eb-cd6d-4c78-8838-2d397990ecd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:25:21 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-1dee628e-c210-46f7-9eb8-8e3fa6b1df68 tempest-ProjectReaderTests-1980438739 None] Created volume successfully. Sep 06 08:25:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ebc6ce8a-1bf8-4f9d-a816-83045d74e25f tempest-ProjectReaderTests-1980438739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:21 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ebc6ce8a-1bf8-4f9d-a816-83045d74e25f tempest-ProjectReaderTests-1980438739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:22 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-ebc6ce8a-1bf8-4f9d-a816-83045d74e25f tempest-ProjectReaderTests-1980438739 None] Creating offline snapshot 6ea73329-cc8d-4f93-9756-c946487488f0 of volume 6cc21333-3bce-4df1-a669-e6b01eb7ab2d {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:25:22 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25018a1-901d-4144-a5e3-f4cbd3f9ade1]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:25:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ebc6ce8a-1bf8-4f9d-a816-83045d74e25f tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:22 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d Sep 06 08:25:22 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:22 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ebc6ce8a-1bf8-4f9d-a816-83045d74e25f tempest-ProjectReaderTests-1980438739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d" returned: 0 in 0.357s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ebc6ce8a-1bf8-4f9d-a816-83045d74e25f tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.6ea73329-cc8d-4f93-9756-c946487488f0 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:22 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.6ea73329-cc8d-4f93-9756-c946487488f0 1G Sep 06 08:25:22 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:22 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ebc6ce8a-1bf8-4f9d-a816-83045d74e25f tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.6ea73329-cc8d-4f93-9756-c946487488f0 1G" returned: 0 in 0.368s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:22 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ebc6ce8a-1bf8-4f9d-a816-83045d74e25f tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.6ea73329-cc8d-4f93-9756-c946487488f0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:22 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.6ea73329-cc8d-4f93-9756-c946487488f0 Sep 06 08:25:22 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:23 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ebc6ce8a-1bf8-4f9d-a816-83045d74e25f tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.6ea73329-cc8d-4f93-9756-c946487488f0" returned: 0 in 0.281s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:23 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-ebc6ce8a-1bf8-4f9d-a816-83045d74e25f tempest-ProjectReaderTests-1980438739 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.6ea73329-cc8d-4f93-9756-c946487488f0 is being set with open permissions: ugo+rw Sep 06 08:25:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ebc6ce8a-1bf8-4f9d-a816-83045d74e25f tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.6ea73329-cc8d-4f93-9756-c946487488f0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:23 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.6ea73329-cc8d-4f93-9756-c946487488f0 Sep 06 08:25:23 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:23 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ebc6ce8a-1bf8-4f9d-a816-83045d74e25f tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.6ea73329-cc8d-4f93-9756-c946487488f0" returned: 0 in 0.237s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ebc6ce8a-1bf8-4f9d-a816-83045d74e25f tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:23 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.info Sep 06 08:25:23 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:23 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ebc6ce8a-1bf8-4f9d-a816-83045d74e25f tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.info" returned: 0 in 0.247s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:23 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-ebc6ce8a-1bf8-4f9d-a816-83045d74e25f tempest-ProjectReaderTests-1980438739 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.info is being set with open permissions: ugo+rw Sep 06 08:25:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ebc6ce8a-1bf8-4f9d-a816-83045d74e25f tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:23 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.info Sep 06 08:25:23 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:23 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-ebc6ce8a-1bf8-4f9d-a816-83045d74e25f tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.info" returned: 0 in 0.243s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:23 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-ebc6ce8a-1bf8-4f9d-a816-83045d74e25f tempest-ProjectReaderTests-1980438739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.813s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:23 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-ebc6ce8a-1bf8-4f9d-a816-83045d74e25f tempest-ProjectReaderTests-1980438739 None] Create snapshot completed successfully Sep 06 08:25:24 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-8baa66d7-0692-4422-bc1f-5f8e462a31fc tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-6ea73329-cc8d-4f93-9756-c946487488f0-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:24 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-8baa66d7-0692-4422-bc1f-5f8e462a31fc tempest-ProjectReaderTests-1980438739 None] Lock "cinder-6ea73329-cc8d-4f93-9756-c946487488f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:24 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-8baa66d7-0692-4422-bc1f-5f8e462a31fc tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-quobyte-6cc21333-3bce-4df1-a669-e6b01eb7ab2d" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:24 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-8baa66d7-0692-4422-bc1f-5f8e462a31fc tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-6cc21333-3bce-4df1-a669-e6b01eb7ab2d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:24 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-8baa66d7-0692-4422-bc1f-5f8e462a31fc tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-quobyte-6ea73329-cc8d-4f93-9756-c946487488f0" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:24 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-8baa66d7-0692-4422-bc1f-5f8e462a31fc tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-6ea73329-cc8d-4f93-9756-c946487488f0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-8baa66d7-0692-4422-bc1f-5f8e462a31fc tempest-ProjectReaderTests-1980438739 None] Deleting offline snapshot 6ea73329-cc8d-4f93-9756-c946487488f0 of volume 6cc21333-3bce-4df1-a669-e6b01eb7ab2d {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:25:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-8baa66d7-0692-4422-bc1f-5f8e462a31fc tempest-ProjectReaderTests-1980438739 None] snapshot_file for this snap is: volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.6ea73329-cc8d-4f93-9756-c946487488f0 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:25:24 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec0e5fe-adff-4c12-a39f-04e41eb190c1]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:25:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8baa66d7-0692-4422-bc1f-5f8e462a31fc tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.6ea73329-cc8d-4f93-9756-c946487488f0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:24 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.6ea73329-cc8d-4f93-9756-c946487488f0 Sep 06 08:25:24 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:24 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8baa66d7-0692-4422-bc1f-5f8e462a31fc tempest-ProjectReaderTests-1980438739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.6ea73329-cc8d-4f93-9756-c946487488f0" returned: 0 in 0.344s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:24 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-8baa66d7-0692-4422-bc1f-5f8e462a31fc tempest-ProjectReaderTests-1980438739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:25:24 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfc7255-d119-4261-8308-5db819385165]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:25:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8baa66d7-0692-4422-bc1f-5f8e462a31fc tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:24 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d Sep 06 08:25:24 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:24 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8baa66d7-0692-4422-bc1f-5f8e462a31fc tempest-ProjectReaderTests-1980438739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d" returned: 0 in 0.344s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:24 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8baa66d7-0692-4422-bc1f-5f8e462a31fc tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.6ea73329-cc8d-4f93-9756-c946487488f0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:24 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.6ea73329-cc8d-4f93-9756-c946487488f0 Sep 06 08:25:24 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:25 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8baa66d7-0692-4422-bc1f-5f8e462a31fc tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.6ea73329-cc8d-4f93-9756-c946487488f0" returned: 0 in 0.326s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8baa66d7-0692-4422-bc1f-5f8e462a31fc tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.6ea73329-cc8d-4f93-9756-c946487488f0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:25 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.6ea73329-cc8d-4f93-9756-c946487488f0 Sep 06 08:25:25 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:25 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:25 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8baa66d7-0692-4422-bc1f-5f8e462a31fc tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d.6ea73329-cc8d-4f93-9756-c946487488f0" returned: 0 in 0.240s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:25 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-8baa66d7-0692-4422-bc1f-5f8e462a31fc tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-6ea73329-cc8d-4f93-9756-c946487488f0" released by "_delete_snapshot" :: held 1.336s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:25 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-8baa66d7-0692-4422-bc1f-5f8e462a31fc tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-6cc21333-3bce-4df1-a669-e6b01eb7ab2d" released by "delete_snapshot" :: held 1.357s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:25 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-8baa66d7-0692-4422-bc1f-5f8e462a31fc tempest-ProjectReaderTests-1980438739 None] Created reservations ['6245c1e5-557d-4339-85d3-bfd804805666', 'd6b461dc-58d1-464c-8cd2-c41f77bad8d1', '0a773cc3-65dd-4f42-88c2-9e9fe38e83f6', '155e8263-b469-4b09-af17-a0d09e4f2c52'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:25:25 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-8baa66d7-0692-4422-bc1f-5f8e462a31fc tempest-ProjectReaderTests-1980438739 None] Delete snapshot completed successfully. Sep 06 08:25:25 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-8baa66d7-0692-4422-bc1f-5f8e462a31fc tempest-ProjectReaderTests-1980438739 None] Lock "cinder-6ea73329-cc8d-4f93-9756-c946487488f0-delete_snapshot" released by "delete_snapshot" :: held 1.479s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-44332d34-3d00-458a-83b7-98d9fdafa2bb tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-6cc21333-3bce-4df1-a669-e6b01eb7ab2d-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-44332d34-3d00-458a-83b7-98d9fdafa2bb tempest-ProjectReaderTests-1980438739 None] Lock "cinder-6cc21333-3bce-4df1-a669-e6b01eb7ab2d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-44332d34-3d00-458a-83b7-98d9fdafa2bb tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-quobyte-6cc21333-3bce-4df1-a669-e6b01eb7ab2d" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-44332d34-3d00-458a-83b7-98d9fdafa2bb tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-6cc21333-3bce-4df1-a669-e6b01eb7ab2d" acquired by "delete_volume" :: waited 0.014s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:26 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17c43e6-e0cc-438c-bf21-a45ea9b92ccf]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:25:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-44332d34-3d00-458a-83b7-98d9fdafa2bb tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:26 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d Sep 06 08:25:26 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:26 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-44332d34-3d00-458a-83b7-98d9fdafa2bb tempest-ProjectReaderTests-1980438739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d" returned: 0 in 0.346s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-44332d34-3d00-458a-83b7-98d9fdafa2bb tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:26 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d Sep 06 08:25:26 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:26 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:26 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-44332d34-3d00-458a-83b7-98d9fdafa2bb tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6cc21333-3bce-4df1-a669-e6b01eb7ab2d" returned: 0 in 0.238s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:26 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-44332d34-3d00-458a-83b7-98d9fdafa2bb tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-6cc21333-3bce-4df1-a669-e6b01eb7ab2d" released by "delete_volume" :: held 0.635s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-44332d34-3d00-458a-83b7-98d9fdafa2bb tempest-ProjectReaderTests-1980438739 None] Created reservations ['e4fc4ff1-5cf0-489a-b9b8-e1a95d9d686f', '2c6e7d09-96b5-4d0f-ac6c-628b5e1e12e8', '53cbc5bc-8160-4f5b-8cd6-0f19b5c6102b', 'b6b975ea-6cb1-4aa5-b25c-9a58027eb2fd'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-44332d34-3d00-458a-83b7-98d9fdafa2bb tempest-ProjectReaderTests-1980438739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-44332d34-3d00-458a-83b7-98d9fdafa2bb tempest-ProjectReaderTests-1980438739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-44332d34-3d00-458a-83b7-98d9fdafa2bb tempest-ProjectReaderTests-1980438739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-44332d34-3d00-458a-83b7-98d9fdafa2bb tempest-ProjectReaderTests-1980438739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-44332d34-3d00-458a-83b7-98d9fdafa2bb tempest-ProjectReaderTests-1980438739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-44332d34-3d00-458a-83b7-98d9fdafa2bb tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:27 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:25:27 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:27 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-44332d34-3d00-458a-83b7-98d9fdafa2bb tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.246s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-44332d34-3d00-458a-83b7-98d9fdafa2bb tempest-ProjectReaderTests-1980438739 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:25:27 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-44332d34-3d00-458a-83b7-98d9fdafa2bb tempest-ProjectReaderTests-1980438739 None] Deleted volume successfully. Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-44332d34-3d00-458a-83b7-98d9fdafa2bb tempest-ProjectReaderTests-1980438739 None] Lock "cinder-6cc21333-3bce-4df1-a669-e6b01eb7ab2d-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Flow 'volume_create_manager' (e59ff6e4-ef55-4c15-974e-9ab060935373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b487c68-b99a-4147-9eed-c60a28e70a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b487c68-b99a-4147-9eed-c60a28e70a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-820168562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d66a01e-6933-41b0-97b9-5936d6961e98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983b4441d7994f128020eab6b42b1997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:25:28Z,use_quota=True,user_id='72c02a206c014afeb3122237bf4bdfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a788b2-add1-4417-b5ce-eb47e4785200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a788b2-add1-4417-b5ce-eb47e4785200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (633c8510-490d-4ed6-9d08-3ec512863b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (633c8510-490d-4ed6-9d08-3ec512863b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d66a01e-6933-41b0-97b9-5936d6961e98', 'volume_name': 'volume-6d66a01e-6933-41b0-97b9-5936d6961e98', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347ea15b-4001-4c91-b161-d457751cb928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347ea15b-4001-4c91-b161-d457751cb928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7d3653-6c57-47da-ba95-d95f568abfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:27 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Volume 6d66a01e-6933-41b0-97b9-5936d6961e98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d66a01e-6933-41b0-97b9-5936d6961e98', 'volume_size': 1} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-820168562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d66a01e-6933-41b0-97b9-5936d6961e98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983b4441d7994f128020eab6b42b1997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:25:28Z,use_quota=True,user_id='72c02a206c014afeb3122237bf4bdfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Creating volume 6d66a01e-6933-41b0-97b9-5936d6961e98 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:25:27 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:25:27 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:27 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98 1073741824 Sep 06 08:25:27 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:28 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98 1073741824" returned: 0 in 0.403s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:28 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98 Sep 06 08:25:28 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:28 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98" returned: 0 in 0.236s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:28 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:25:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:28 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7d3653-6c57-47da-ba95-d95f568abfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d66a01e-6933-41b0-97b9-5936d6961e98', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:28 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a4b44f-e7ef-4489-90b0-16fd6821d172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:28 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Volume volume-6d66a01e-6933-41b0-97b9-5936d6961e98 (6d66a01e-6933-41b0-97b9-5936d6961e98): created successfully Sep 06 08:25:28 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a4b44f-e7ef-4489-90b0-16fd6821d172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:28 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Flow 'volume_create_manager' (e59ff6e4-ef55-4c15-974e-9ab060935373) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:25:28 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-60c1532a-936d-460e-aadd-9921d95bda5a tempest-ProjectReaderTests-1980438739 None] Created volume successfully. Sep 06 08:25:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b97de83b-3743-4c86-9ce0-e759a94ee720 tempest-ProjectReaderTests-1980438739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:28 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b97de83b-3743-4c86-9ce0-e759a94ee720 tempest-ProjectReaderTests-1980438739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:29 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-b97de83b-3743-4c86-9ce0-e759a94ee720 tempest-ProjectReaderTests-1980438739 None] Creating offline snapshot 88146c6f-cf45-461b-bcf1-6155a110b0e8 of volume 6d66a01e-6933-41b0-97b9-5936d6961e98 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:25:29 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6c2aad-208a-449c-978e-e9a061e72e9c]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:25:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b97de83b-3743-4c86-9ce0-e759a94ee720 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:29 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98 Sep 06 08:25:29 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:29 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b97de83b-3743-4c86-9ce0-e759a94ee720 tempest-ProjectReaderTests-1980438739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98" returned: 0 in 0.357s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b97de83b-3743-4c86-9ce0-e759a94ee720 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.88146c6f-cf45-461b-bcf1-6155a110b0e8 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:29 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.88146c6f-cf45-461b-bcf1-6155a110b0e8 1G Sep 06 08:25:29 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:29 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b97de83b-3743-4c86-9ce0-e759a94ee720 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.88146c6f-cf45-461b-bcf1-6155a110b0e8 1G" returned: 0 in 0.367s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:29 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b97de83b-3743-4c86-9ce0-e759a94ee720 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d66a01e-6933-41b0-97b9-5936d6961e98 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.88146c6f-cf45-461b-bcf1-6155a110b0e8 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:29 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d66a01e-6933-41b0-97b9-5936d6961e98 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.88146c6f-cf45-461b-bcf1-6155a110b0e8 Sep 06 08:25:29 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:30 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b97de83b-3743-4c86-9ce0-e759a94ee720 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d66a01e-6933-41b0-97b9-5936d6961e98 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.88146c6f-cf45-461b-bcf1-6155a110b0e8" returned: 0 in 0.293s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:30 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-b97de83b-3743-4c86-9ce0-e759a94ee720 tempest-ProjectReaderTests-1980438739 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.88146c6f-cf45-461b-bcf1-6155a110b0e8 is being set with open permissions: ugo+rw Sep 06 08:25:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b97de83b-3743-4c86-9ce0-e759a94ee720 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.88146c6f-cf45-461b-bcf1-6155a110b0e8 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:30 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.88146c6f-cf45-461b-bcf1-6155a110b0e8 Sep 06 08:25:30 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:30 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b97de83b-3743-4c86-9ce0-e759a94ee720 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.88146c6f-cf45-461b-bcf1-6155a110b0e8" returned: 0 in 0.241s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b97de83b-3743-4c86-9ce0-e759a94ee720 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:30 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.info Sep 06 08:25:30 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:30 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b97de83b-3743-4c86-9ce0-e759a94ee720 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.info" returned: 0 in 0.248s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:30 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-b97de83b-3743-4c86-9ce0-e759a94ee720 tempest-ProjectReaderTests-1980438739 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.info is being set with open permissions: ugo+rw Sep 06 08:25:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b97de83b-3743-4c86-9ce0-e759a94ee720 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:30 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.info Sep 06 08:25:30 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:30 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b97de83b-3743-4c86-9ce0-e759a94ee720 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.info" returned: 0 in 0.235s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:30 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b97de83b-3743-4c86-9ce0-e759a94ee720 tempest-ProjectReaderTests-1980438739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.817s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:30 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-b97de83b-3743-4c86-9ce0-e759a94ee720 tempest-ProjectReaderTests-1980438739 None] Create snapshot completed successfully Sep 06 08:25:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-8b07c7e5-9778-4109-b7e7-c76e5618d23a tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-88146c6f-cf45-461b-bcf1-6155a110b0e8-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-8b07c7e5-9778-4109-b7e7-c76e5618d23a tempest-ProjectReaderTests-1980438739 None] Lock "cinder-88146c6f-cf45-461b-bcf1-6155a110b0e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-8b07c7e5-9778-4109-b7e7-c76e5618d23a tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-quobyte-6d66a01e-6933-41b0-97b9-5936d6961e98" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-8b07c7e5-9778-4109-b7e7-c76e5618d23a tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-6d66a01e-6933-41b0-97b9-5936d6961e98" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-8b07c7e5-9778-4109-b7e7-c76e5618d23a tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-quobyte-88146c6f-cf45-461b-bcf1-6155a110b0e8" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:31 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-8b07c7e5-9778-4109-b7e7-c76e5618d23a tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-88146c6f-cf45-461b-bcf1-6155a110b0e8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-8b07c7e5-9778-4109-b7e7-c76e5618d23a tempest-ProjectReaderTests-1980438739 None] Deleting offline snapshot 88146c6f-cf45-461b-bcf1-6155a110b0e8 of volume 6d66a01e-6933-41b0-97b9-5936d6961e98 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:25:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-8b07c7e5-9778-4109-b7e7-c76e5618d23a tempest-ProjectReaderTests-1980438739 None] snapshot_file for this snap is: volume-6d66a01e-6933-41b0-97b9-5936d6961e98.88146c6f-cf45-461b-bcf1-6155a110b0e8 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:25:31 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[261c4595-5e71-4299-8d34-5b503f9a3d58]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:25:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8b07c7e5-9778-4109-b7e7-c76e5618d23a tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.88146c6f-cf45-461b-bcf1-6155a110b0e8 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:31 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.88146c6f-cf45-461b-bcf1-6155a110b0e8 Sep 06 08:25:31 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:31 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8b07c7e5-9778-4109-b7e7-c76e5618d23a tempest-ProjectReaderTests-1980438739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.88146c6f-cf45-461b-bcf1-6155a110b0e8" returned: 0 in 0.351s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:31 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-8b07c7e5-9778-4109-b7e7-c76e5618d23a tempest-ProjectReaderTests-1980438739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d66a01e-6933-41b0-97b9-5936d6961e98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:25:31 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[64374e4d-9f58-4c8a-b376-3138c016df80]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:25:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8b07c7e5-9778-4109-b7e7-c76e5618d23a tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:31 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98 Sep 06 08:25:31 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:31 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8b07c7e5-9778-4109-b7e7-c76e5618d23a tempest-ProjectReaderTests-1980438739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98" returned: 0 in 0.357s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:31 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8b07c7e5-9778-4109-b7e7-c76e5618d23a tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.88146c6f-cf45-461b-bcf1-6155a110b0e8 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:31 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.88146c6f-cf45-461b-bcf1-6155a110b0e8 Sep 06 08:25:31 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:32 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8b07c7e5-9778-4109-b7e7-c76e5618d23a tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.88146c6f-cf45-461b-bcf1-6155a110b0e8" returned: 0 in 0.333s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8b07c7e5-9778-4109-b7e7-c76e5618d23a tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.88146c6f-cf45-461b-bcf1-6155a110b0e8 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:32 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.88146c6f-cf45-461b-bcf1-6155a110b0e8 Sep 06 08:25:32 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:32 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:32 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8b07c7e5-9778-4109-b7e7-c76e5618d23a tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98.88146c6f-cf45-461b-bcf1-6155a110b0e8" returned: 0 in 0.244s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:32 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-8b07c7e5-9778-4109-b7e7-c76e5618d23a tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-88146c6f-cf45-461b-bcf1-6155a110b0e8" released by "_delete_snapshot" :: held 1.372s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:32 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-8b07c7e5-9778-4109-b7e7-c76e5618d23a tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-6d66a01e-6933-41b0-97b9-5936d6961e98" released by "delete_snapshot" :: held 1.396s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:32 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-8b07c7e5-9778-4109-b7e7-c76e5618d23a tempest-ProjectReaderTests-1980438739 None] Created reservations ['e2c55dea-b5f6-40a8-9443-7b5df7d8b9fa', 'a25e9348-314e-4ebb-b05f-bd635063b1ab', '24cf3e52-cc2a-4abb-bc10-cee001e7a746', 'b05fcd2e-f3d9-46ea-be49-126fb677899b'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:25:32 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-8b07c7e5-9778-4109-b7e7-c76e5618d23a tempest-ProjectReaderTests-1980438739 None] Delete snapshot completed successfully. Sep 06 08:25:32 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-8b07c7e5-9778-4109-b7e7-c76e5618d23a tempest-ProjectReaderTests-1980438739 None] Lock "cinder-88146c6f-cf45-461b-bcf1-6155a110b0e8-delete_snapshot" released by "delete_snapshot" :: held 1.521s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:33 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b3c3c69a-1bf0-47ea-ab4a-77b6d4606f4a tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-6d66a01e-6933-41b0-97b9-5936d6961e98-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:33 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b3c3c69a-1bf0-47ea-ab4a-77b6d4606f4a tempest-ProjectReaderTests-1980438739 None] Lock "cinder-6d66a01e-6933-41b0-97b9-5936d6961e98-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:33 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b3c3c69a-1bf0-47ea-ab4a-77b6d4606f4a tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-quobyte-6d66a01e-6933-41b0-97b9-5936d6961e98" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:33 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b3c3c69a-1bf0-47ea-ab4a-77b6d4606f4a tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-6d66a01e-6933-41b0-97b9-5936d6961e98" acquired by "delete_volume" :: waited 0.017s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:33 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b1509a-e35e-480a-b28d-e2bb6f064658]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:25:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b3c3c69a-1bf0-47ea-ab4a-77b6d4606f4a tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:33 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98 Sep 06 08:25:33 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:33 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b3c3c69a-1bf0-47ea-ab4a-77b6d4606f4a tempest-ProjectReaderTests-1980438739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98" returned: 0 in 0.354s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b3c3c69a-1bf0-47ea-ab4a-77b6d4606f4a tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:33 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98 Sep 06 08:25:33 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:33 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:33 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b3c3c69a-1bf0-47ea-ab4a-77b6d4606f4a tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-6d66a01e-6933-41b0-97b9-5936d6961e98" returned: 0 in 0.253s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b3c3c69a-1bf0-47ea-ab4a-77b6d4606f4a tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-6d66a01e-6933-41b0-97b9-5936d6961e98" released by "delete_volume" :: held 0.661s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-b3c3c69a-1bf0-47ea-ab4a-77b6d4606f4a tempest-ProjectReaderTests-1980438739 None] Created reservations ['6ce4c43c-1f79-4747-91d0-2138ec51254d', 'a5467b9f-5abc-4cff-9c93-2af5b972730e', '6609c266-78ce-4a8b-bb87-90e7b4f0823d', '1a1572e2-4240-45a3-a2f0-dba7a75a0ab4'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b3c3c69a-1bf0-47ea-ab4a-77b6d4606f4a tempest-ProjectReaderTests-1980438739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b3c3c69a-1bf0-47ea-ab4a-77b6d4606f4a tempest-ProjectReaderTests-1980438739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b3c3c69a-1bf0-47ea-ab4a-77b6d4606f4a tempest-ProjectReaderTests-1980438739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-b3c3c69a-1bf0-47ea-ab4a-77b6d4606f4a tempest-ProjectReaderTests-1980438739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-b3c3c69a-1bf0-47ea-ab4a-77b6d4606f4a tempest-ProjectReaderTests-1980438739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b3c3c69a-1bf0-47ea-ab4a-77b6d4606f4a tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:34 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:25:34 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:34 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-b3c3c69a-1bf0-47ea-ab4a-77b6d4606f4a tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.256s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-b3c3c69a-1bf0-47ea-ab4a-77b6d4606f4a tempest-ProjectReaderTests-1980438739 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:25:34 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-b3c3c69a-1bf0-47ea-ab4a-77b6d4606f4a tempest-ProjectReaderTests-1980438739 None] Deleted volume successfully. Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-b3c3c69a-1bf0-47ea-ab4a-77b6d4606f4a tempest-ProjectReaderTests-1980438739 None] Lock "cinder-6d66a01e-6933-41b0-97b9-5936d6961e98-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Flow 'volume_create_manager' (bcd1cbdb-fe58-475b-8c85-d638561eb93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e2ebd3-c165-47b5-bfd9-21195cfe3ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e2ebd3-c165-47b5-bfd9-21195cfe3ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1959495245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17dd3c5-bd82-40b5-baf3-a85c74f848f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983b4441d7994f128020eab6b42b1997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:25:35Z,use_quota=True,user_id='72c02a206c014afeb3122237bf4bdfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327ce82d-452e-4123-a886-1dc6605c7ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327ce82d-452e-4123-a886-1dc6605c7ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d48931f6-4d3c-4231-a131-b7816bbc2bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d48931f6-4d3c-4231-a131-b7816bbc2bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd17dd3c5-bd82-40b5-baf3-a85c74f848f0', 'volume_name': 'volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4fbddf-da63-491a-a205-746c112b9c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4fbddf-da63-491a-a205-746c112b9c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17fdec3f-6202-4730-bb12-3d024eb7870a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:34 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Volume d17dd3c5-bd82-40b5-baf3-a85c74f848f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0', 'volume_size': 1} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1959495245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17dd3c5-bd82-40b5-baf3-a85c74f848f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983b4441d7994f128020eab6b42b1997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:25:35Z,use_quota=True,user_id='72c02a206c014afeb3122237bf4bdfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Creating volume d17dd3c5-bd82-40b5-baf3-a85c74f848f0 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:25:34 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:25:34 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:34 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0 1073741824 Sep 06 08:25:34 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:35 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0 1073741824" returned: 0 in 0.399s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:35 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0 Sep 06 08:25:35 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:35 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0" returned: 0 in 0.240s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:35 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:25:35 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17fdec3f-6202-4730-bb12-3d024eb7870a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (423c297f-fdec-4e13-8d16-8d20ac7eb511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:35 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Volume volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0 (d17dd3c5-bd82-40b5-baf3-a85c74f848f0): created successfully Sep 06 08:25:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (423c297f-fdec-4e13-8d16-8d20ac7eb511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:35 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Flow 'volume_create_manager' (bcd1cbdb-fe58-475b-8c85-d638561eb93a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:25:35 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-653a1a46-1163-4b04-be1b-53698058785a tempest-ProjectReaderTests-1980438739 None] Created volume successfully. Sep 06 08:25:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-eaf231ad-fcab-402b-a83f-fae6ae97b813 tempest-ProjectReaderTests-1980438739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-eaf231ad-fcab-402b-a83f-fae6ae97b813 tempest-ProjectReaderTests-1980438739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:36 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-eaf231ad-fcab-402b-a83f-fae6ae97b813 tempest-ProjectReaderTests-1980438739 None] Creating offline snapshot 1fe20df9-0cff-4bd1-b3b2-c3444b523326 of volume d17dd3c5-bd82-40b5-baf3-a85c74f848f0 {{(pid=87307) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 08:25:36 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e2f3c3-cbd1-4c3b-8cb6-a2682771ef2e]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:25:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eaf231ad-fcab-402b-a83f-fae6ae97b813 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:36 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0 Sep 06 08:25:36 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:36 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eaf231ad-fcab-402b-a83f-fae6ae97b813 tempest-ProjectReaderTests-1980438739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0" returned: 0 in 0.360s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eaf231ad-fcab-402b-a83f-fae6ae97b813 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.1fe20df9-0cff-4bd1-b3b2-c3444b523326 1G {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:36 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.1fe20df9-0cff-4bd1-b3b2-c3444b523326 1G Sep 06 08:25:36 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:36 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eaf231ad-fcab-402b-a83f-fae6ae97b813 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.1fe20df9-0cff-4bd1-b3b2-c3444b523326 1G" returned: 0 in 0.383s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:36 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eaf231ad-fcab-402b-a83f-fae6ae97b813 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.1fe20df9-0cff-4bd1-b3b2-c3444b523326 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:36 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.1fe20df9-0cff-4bd1-b3b2-c3444b523326 Sep 06 08:25:36 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:37 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eaf231ad-fcab-402b-a83f-fae6ae97b813 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0 -F qcow2 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.1fe20df9-0cff-4bd1-b3b2-c3444b523326" returned: 0 in 0.289s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:37 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-eaf231ad-fcab-402b-a83f-fae6ae97b813 tempest-ProjectReaderTests-1980438739 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.1fe20df9-0cff-4bd1-b3b2-c3444b523326 is being set with open permissions: ugo+rw Sep 06 08:25:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eaf231ad-fcab-402b-a83f-fae6ae97b813 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.1fe20df9-0cff-4bd1-b3b2-c3444b523326 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:37 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.1fe20df9-0cff-4bd1-b3b2-c3444b523326 Sep 06 08:25:37 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:37 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eaf231ad-fcab-402b-a83f-fae6ae97b813 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.1fe20df9-0cff-4bd1-b3b2-c3444b523326" returned: 0 in 0.238s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eaf231ad-fcab-402b-a83f-fae6ae97b813 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:37 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.info Sep 06 08:25:37 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:37 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eaf231ad-fcab-402b-a83f-fae6ae97b813 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.info" returned: 0 in 0.241s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:37 devstack cinder-volume[87307]: WARNING cinder.volume.drivers.remotefs [None req-eaf231ad-fcab-402b-a83f-fae6ae97b813 tempest-ProjectReaderTests-1980438739 None] /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.info is being set with open permissions: ugo+rw Sep 06 08:25:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eaf231ad-fcab-402b-a83f-fae6ae97b813 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.info {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:37 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.info Sep 06 08:25:37 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:37 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-eaf231ad-fcab-402b-a83f-fae6ae97b813 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.info" returned: 0 in 0.242s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:37 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-eaf231ad-fcab-402b-a83f-fae6ae97b813 tempest-ProjectReaderTests-1980438739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:37 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-eaf231ad-fcab-402b-a83f-fae6ae97b813 tempest-ProjectReaderTests-1980438739 None] Create snapshot completed successfully Sep 06 08:25:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-775d6aca-7dd1-4a63-af8e-7e02441745ca tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-1fe20df9-0cff-4bd1-b3b2-c3444b523326-delete_snapshot" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-775d6aca-7dd1-4a63-af8e-7e02441745ca tempest-ProjectReaderTests-1980438739 None] Lock "cinder-1fe20df9-0cff-4bd1-b3b2-c3444b523326-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-775d6aca-7dd1-4a63-af8e-7e02441745ca tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-quobyte-d17dd3c5-bd82-40b5-baf3-a85c74f848f0" by "delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-775d6aca-7dd1-4a63-af8e-7e02441745ca tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-d17dd3c5-bd82-40b5-baf3-a85c74f848f0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-775d6aca-7dd1-4a63-af8e-7e02441745ca tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-quobyte-1fe20df9-0cff-4bd1-b3b2-c3444b523326" by "_delete_snapshot" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:38 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-775d6aca-7dd1-4a63-af8e-7e02441745ca tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-1fe20df9-0cff-4bd1-b3b2-c3444b523326" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:38 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-775d6aca-7dd1-4a63-af8e-7e02441745ca tempest-ProjectReaderTests-1980438739 None] Deleting offline snapshot 1fe20df9-0cff-4bd1-b3b2-c3444b523326 of volume d17dd3c5-bd82-40b5-baf3-a85c74f848f0 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 08:25:38 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-775d6aca-7dd1-4a63-af8e-7e02441745ca tempest-ProjectReaderTests-1980438739 None] snapshot_file for this snap is: volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.1fe20df9-0cff-4bd1-b3b2-c3444b523326 {{(pid=87307) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 08:25:38 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[30037b3a-4c35-4111-b7ff-82e380157e01]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:25:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-775d6aca-7dd1-4a63-af8e-7e02441745ca tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.1fe20df9-0cff-4bd1-b3b2-c3444b523326 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:38 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.1fe20df9-0cff-4bd1-b3b2-c3444b523326 Sep 06 08:25:38 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:38 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-775d6aca-7dd1-4a63-af8e-7e02441745ca tempest-ProjectReaderTests-1980438739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.1fe20df9-0cff-4bd1-b3b2-c3444b523326" returned: 0 in 0.344s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:38 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-775d6aca-7dd1-4a63-af8e-7e02441745ca tempest-ProjectReaderTests-1980438739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87307) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 08:25:38 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[611b240e-2b72-4a22-8524-f88c87ca934d]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:25:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-775d6aca-7dd1-4a63-af8e-7e02441745ca tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:38 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0 Sep 06 08:25:38 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:38 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-775d6aca-7dd1-4a63-af8e-7e02441745ca tempest-ProjectReaderTests-1980438739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0" returned: 0 in 0.343s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:38 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-775d6aca-7dd1-4a63-af8e-7e02441745ca tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.1fe20df9-0cff-4bd1-b3b2-c3444b523326 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:38 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.1fe20df9-0cff-4bd1-b3b2-c3444b523326 Sep 06 08:25:38 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:39 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-775d6aca-7dd1-4a63-af8e-7e02441745ca tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.1fe20df9-0cff-4bd1-b3b2-c3444b523326" returned: 0 in 0.328s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-775d6aca-7dd1-4a63-af8e-7e02441745ca tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.1fe20df9-0cff-4bd1-b3b2-c3444b523326 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:39 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.1fe20df9-0cff-4bd1-b3b2-c3444b523326 Sep 06 08:25:39 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:39 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:39 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-775d6aca-7dd1-4a63-af8e-7e02441745ca tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0.1fe20df9-0cff-4bd1-b3b2-c3444b523326" returned: 0 in 0.243s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:39 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-775d6aca-7dd1-4a63-af8e-7e02441745ca tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-1fe20df9-0cff-4bd1-b3b2-c3444b523326" released by "_delete_snapshot" :: held 1.346s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:39 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-775d6aca-7dd1-4a63-af8e-7e02441745ca tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-d17dd3c5-bd82-40b5-baf3-a85c74f848f0" released by "delete_snapshot" :: held 1.368s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:39 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-775d6aca-7dd1-4a63-af8e-7e02441745ca tempest-ProjectReaderTests-1980438739 None] Created reservations ['11070ab4-72ff-4041-9572-8bf82f51a315', 'd54acaf2-76ef-4380-8d02-dc55679987f3', 'e0660f2d-4228-4697-a1cf-0a63261a6632', 'cd8d3001-ce64-4729-8cef-f1892bb5dc18'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:25:39 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-775d6aca-7dd1-4a63-af8e-7e02441745ca tempest-ProjectReaderTests-1980438739 None] Delete snapshot completed successfully. Sep 06 08:25:39 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-775d6aca-7dd1-4a63-af8e-7e02441745ca tempest-ProjectReaderTests-1980438739 None] Lock "cinder-1fe20df9-0cff-4bd1-b3b2-c3444b523326-delete_snapshot" released by "delete_snapshot" :: held 1.490s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f51a3c63-2859-40e9-ad27-bc43a9b89ff9 tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-d17dd3c5-bd82-40b5-baf3-a85c74f848f0-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f51a3c63-2859-40e9-ad27-bc43a9b89ff9 tempest-ProjectReaderTests-1980438739 None] Lock "cinder-d17dd3c5-bd82-40b5-baf3-a85c74f848f0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f51a3c63-2859-40e9-ad27-bc43a9b89ff9 tempest-ProjectReaderTests-1980438739 None] Acquiring lock "cinder-quobyte-d17dd3c5-bd82-40b5-baf3-a85c74f848f0" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f51a3c63-2859-40e9-ad27-bc43a9b89ff9 tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-d17dd3c5-bd82-40b5-baf3-a85c74f848f0" acquired by "delete_volume" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:40 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec376318-cb1f-465b-a5c1-25a16f0c89cb]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:25:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f51a3c63-2859-40e9-ad27-bc43a9b89ff9 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:40 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0 Sep 06 08:25:40 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:40 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f51a3c63-2859-40e9-ad27-bc43a9b89ff9 tempest-ProjectReaderTests-1980438739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0" returned: 0 in 0.355s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f51a3c63-2859-40e9-ad27-bc43a9b89ff9 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:40 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0 Sep 06 08:25:40 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:40 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:40 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f51a3c63-2859-40e9-ad27-bc43a9b89ff9 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d17dd3c5-bd82-40b5-baf3-a85c74f848f0" returned: 0 in 0.243s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:40 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f51a3c63-2859-40e9-ad27-bc43a9b89ff9 tempest-ProjectReaderTests-1980438739 None] Lock "cinder-quobyte-d17dd3c5-bd82-40b5-baf3-a85c74f848f0" released by "delete_volume" :: held 0.650s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:41 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-f51a3c63-2859-40e9-ad27-bc43a9b89ff9 tempest-ProjectReaderTests-1980438739 None] Created reservations ['974365ba-0a08-49d3-99b6-6913801d4f25', 'edfba183-b9f7-47b6-80b6-f39f817b4b2a', '24c35341-81c8-4ecb-af4e-feec0cdf4ab4', '0cde0a0d-0718-4160-9796-6767e7b16a6a'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:25:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f51a3c63-2859-40e9-ad27-bc43a9b89ff9 tempest-ProjectReaderTests-1980438739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f51a3c63-2859-40e9-ad27-bc43a9b89ff9 tempest-ProjectReaderTests-1980438739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f51a3c63-2859-40e9-ad27-bc43a9b89ff9 tempest-ProjectReaderTests-1980438739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:25:41 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f51a3c63-2859-40e9-ad27-bc43a9b89ff9 tempest-ProjectReaderTests-1980438739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:25:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f51a3c63-2859-40e9-ad27-bc43a9b89ff9 tempest-ProjectReaderTests-1980438739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f51a3c63-2859-40e9-ad27-bc43a9b89ff9 tempest-ProjectReaderTests-1980438739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:41 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:25:41 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:41 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:41 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f51a3c63-2859-40e9-ad27-bc43a9b89ff9 tempest-ProjectReaderTests-1980438739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.246s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:41 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-f51a3c63-2859-40e9-ad27-bc43a9b89ff9 tempest-ProjectReaderTests-1980438739 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:25:41 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f51a3c63-2859-40e9-ad27-bc43a9b89ff9 tempest-ProjectReaderTests-1980438739 None] Deleted volume successfully. Sep 06 08:25:41 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-f51a3c63-2859-40e9-ad27-bc43a9b89ff9 tempest-ProjectReaderTests-1980438739 None] Lock "cinder-d17dd3c5-bd82-40b5-baf3-a85c74f848f0-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:51 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=70,cinder:UPDATE=88,cinder:INSERT=24,cinder:DELETE=5 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:25:51 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:UPDATE=88,cinder:DELETE=10,cinder:SELECT=66,cinder:INSERT=25 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:25:56 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:25:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Flow 'volume_create_manager' (9a6dfb83-3429-40bd-bb71-0d4be98b4fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:25:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8b65e7-5bda-40a3-a5f8-d4e2a03131aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8b65e7-5bda-40a3-a5f8-d4e2a03131aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1838385112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6d65bb4-008b-4246-a19d-2753d8030580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03033da31e1f4c92bf4bc0c3857594db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:25:56Z,use_quota=True,user_id='d7600853d7814b27b4389f8434c6f936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c935577-d7a2-4bd4-b04d-71cc09e7adfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c935577-d7a2-4bd4-b04d-71cc09e7adfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54c0531-049a-475b-a813-3ba0bd232915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54c0531-049a-475b-a813-3ba0bd232915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6d65bb4-008b-4246-a19d-2753d8030580', 'volume_name': 'volume-d6d65bb4-008b-4246-a19d-2753d8030580', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c56998-8c55-446a-a9db-44cb511477f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c56998-8c55-446a-a9db-44cb511477f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:56 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5af942df-777a-46d0-90cf-2e559ec80f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:56 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Volume d6d65bb4-008b-4246-a19d-2753d8030580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6d65bb4-008b-4246-a19d-2753d8030580', 'volume_size': 1} Sep 06 08:25:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1838385112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6d65bb4-008b-4246-a19d-2753d8030580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03033da31e1f4c92bf4bc0c3857594db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:25:56Z,use_quota=True,user_id='d7600853d7814b27b4389f8434c6f936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:25:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Creating volume d6d65bb4-008b-4246-a19d-2753d8030580 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:25:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:25:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:25:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:56 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:25:56 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:25:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6d65bb4-008b-4246-a19d-2753d8030580 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:56 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6d65bb4-008b-4246-a19d-2753d8030580 1073741824 Sep 06 08:25:56 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:56 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6d65bb4-008b-4246-a19d-2753d8030580 1073741824" returned: 0 in 0.389s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:56 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6d65bb4-008b-4246-a19d-2753d8030580 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:56 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6d65bb4-008b-4246-a19d-2753d8030580 Sep 06 08:25:56 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:57 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6d65bb4-008b-4246-a19d-2753d8030580" returned: 0 in 0.246s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:57 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:25:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5af942df-777a-46d0-90cf-2e559ec80f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6d65bb4-008b-4246-a19d-2753d8030580', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ee8686-1b34-48b5-aed0-685550988bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:57 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Volume volume-d6d65bb4-008b-4246-a19d-2753d8030580 (d6d65bb4-008b-4246-a19d-2753d8030580): created successfully Sep 06 08:25:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ee8686-1b34-48b5-aed0-685550988bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:57 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Flow 'volume_create_manager' (9a6dfb83-3429-40bd-bb71-0d4be98b4fe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:25:57 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-f66a0c00-7d73-4f73-b3ec-7c8b49ccd1c4 tempest-ProjectReaderTests-788465148 None] Created volume successfully. Sep 06 08:25:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-85402a28-3507-4ac7-8a55-252df1d14885 tempest-ProjectReaderTests-788465148 None] Acquiring lock "cinder-d6d65bb4-008b-4246-a19d-2753d8030580-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-85402a28-3507-4ac7-8a55-252df1d14885 tempest-ProjectReaderTests-788465148 None] Lock "cinder-d6d65bb4-008b-4246-a19d-2753d8030580-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-85402a28-3507-4ac7-8a55-252df1d14885 tempest-ProjectReaderTests-788465148 None] Acquiring lock "cinder-quobyte-d6d65bb4-008b-4246-a19d-2753d8030580" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:25:57 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-85402a28-3507-4ac7-8a55-252df1d14885 tempest-ProjectReaderTests-788465148 None] Lock "cinder-quobyte-d6d65bb4-008b-4246-a19d-2753d8030580" acquired by "delete_volume" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:25:57 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[169bcd25-0ded-4ed4-8eae-1eb2ba5c991d]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:25:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-85402a28-3507-4ac7-8a55-252df1d14885 tempest-ProjectReaderTests-788465148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6d65bb4-008b-4246-a19d-2753d8030580 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:57 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6d65bb4-008b-4246-a19d-2753d8030580 Sep 06 08:25:57 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:57 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-85402a28-3507-4ac7-8a55-252df1d14885 tempest-ProjectReaderTests-788465148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6d65bb4-008b-4246-a19d-2753d8030580" returned: 0 in 0.341s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:57 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-85402a28-3507-4ac7-8a55-252df1d14885 tempest-ProjectReaderTests-788465148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6d65bb4-008b-4246-a19d-2753d8030580 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:58 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6d65bb4-008b-4246-a19d-2753d8030580 Sep 06 08:25:58 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:58 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-85402a28-3507-4ac7-8a55-252df1d14885 tempest-ProjectReaderTests-788465148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-d6d65bb4-008b-4246-a19d-2753d8030580" returned: 0 in 0.243s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-85402a28-3507-4ac7-8a55-252df1d14885 tempest-ProjectReaderTests-788465148 None] Lock "cinder-quobyte-d6d65bb4-008b-4246-a19d-2753d8030580" released by "delete_volume" :: held 0.621s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:58 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-85402a28-3507-4ac7-8a55-252df1d14885 tempest-ProjectReaderTests-788465148 None] Created reservations ['2ef27804-71ce-4e2d-9ad8-cdf7b8d2965e', '04602237-2cf5-4b90-bd98-e2963e19d2d0', 'f48a5ff1-985a-41af-a002-b39b0149357d', '8e1f35f8-2817-4f76-8dd0-8a63987c9c62'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:25:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-85402a28-3507-4ac7-8a55-252df1d14885 tempest-ProjectReaderTests-788465148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-85402a28-3507-4ac7-8a55-252df1d14885 tempest-ProjectReaderTests-788465148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:58 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-85402a28-3507-4ac7-8a55-252df1d14885 tempest-ProjectReaderTests-788465148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:25:58 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-85402a28-3507-4ac7-8a55-252df1d14885 tempest-ProjectReaderTests-788465148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:25:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-85402a28-3507-4ac7-8a55-252df1d14885 tempest-ProjectReaderTests-788465148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-85402a28-3507-4ac7-8a55-252df1d14885 tempest-ProjectReaderTests-788465148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:58 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:25:58 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:58 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:58 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-85402a28-3507-4ac7-8a55-252df1d14885 tempest-ProjectReaderTests-788465148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.243s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:58 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-85402a28-3507-4ac7-8a55-252df1d14885 tempest-ProjectReaderTests-788465148 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:25:58 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-85402a28-3507-4ac7-8a55-252df1d14885 tempest-ProjectReaderTests-788465148 None] Deleted volume successfully. Sep 06 08:25:58 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-85402a28-3507-4ac7-8a55-252df1d14885 tempest-ProjectReaderTests-788465148 None] Lock "cinder-d6d65bb4-008b-4246-a19d-2753d8030580-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Flow 'volume_create_manager' (fb4d7395-b8a8-41da-ad1f-b81a58d13b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e38ea35-cd5f-4010-bc83-b63bad1cd8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e38ea35-cd5f-4010-bc83-b63bad1cd8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-912383514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32122457-2761-4521-980b-4c0b1a23e68d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03033da31e1f4c92bf4bc0c3857594db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:25:59Z,use_quota=True,user_id='d7600853d7814b27b4389f8434c6f936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0244f928-83ff-4def-b8fe-af18785eeaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0244f928-83ff-4def-b8fe-af18785eeaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea9cad6-3c18-489e-9065-47aca7894aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea9cad6-3c18-489e-9065-47aca7894aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32122457-2761-4521-980b-4c0b1a23e68d', 'volume_name': 'volume-32122457-2761-4521-980b-4c0b1a23e68d', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34914117-31d6-4f2f-949b-8f42f24645e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34914117-31d6-4f2f-949b-8f42f24645e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f9975e-33ff-4e8a-9dae-308274b146be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:59 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Volume 32122457-2761-4521-980b-4c0b1a23e68d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32122457-2761-4521-980b-4c0b1a23e68d', 'volume_size': 1} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-912383514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32122457-2761-4521-980b-4c0b1a23e68d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03033da31e1f4c92bf4bc0c3857594db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:25:59Z,use_quota=True,user_id='d7600853d7814b27b4389f8434c6f936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Creating volume 32122457-2761-4521-980b-4c0b1a23e68d {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:25:59 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-32122457-2761-4521-980b-4c0b1a23e68d 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:59 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-32122457-2761-4521-980b-4c0b1a23e68d 1073741824 Sep 06 08:25:59 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:59 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-32122457-2761-4521-980b-4c0b1a23e68d 1073741824" returned: 0 in 0.389s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-32122457-2761-4521-980b-4c0b1a23e68d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:59 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-32122457-2761-4521-980b-4c0b1a23e68d Sep 06 08:25:59 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:25:59 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:25:59 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:25:59 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-32122457-2761-4521-980b-4c0b1a23e68d" returned: 0 in 0.247s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f9975e-33ff-4e8a-9dae-308274b146be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32122457-2761-4521-980b-4c0b1a23e68d', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f061edf-4d3c-4934-84e3-0583c98d3527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:25:59 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Volume volume-32122457-2761-4521-980b-4c0b1a23e68d (32122457-2761-4521-980b-4c0b1a23e68d): created successfully Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f061edf-4d3c-4934-84e3-0583c98d3527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Flow 'volume_create_manager' (fb4d7395-b8a8-41da-ad1f-b81a58d13b50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:25:59 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-d0e0355d-2695-4c4c-beaa-7f209c4fe6a9 tempest-ProjectReaderTests-788465148 None] Created volume successfully. Sep 06 08:25:59 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.277s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG oslo_service.periodic_task [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] Running periodic task VolumeManager._thread_info {{(pid=87307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread count: 28 {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 08:25:59 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-6a477e20-57dd-4b95-b937-e6469fe58b11 None None] thread info: [<_MainThread(MainThread, started 139985167040640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 08:26:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2f8a53bd-e532-4c33-95f9-09db49675926 tempest-ProjectReaderTests-788465148 None] Acquiring lock "cinder-32122457-2761-4521-980b-4c0b1a23e68d-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:26:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2f8a53bd-e532-4c33-95f9-09db49675926 tempest-ProjectReaderTests-788465148 None] Lock "cinder-32122457-2761-4521-980b-4c0b1a23e68d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:26:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2f8a53bd-e532-4c33-95f9-09db49675926 tempest-ProjectReaderTests-788465148 None] Acquiring lock "cinder-quobyte-32122457-2761-4521-980b-4c0b1a23e68d" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:26:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2f8a53bd-e532-4c33-95f9-09db49675926 tempest-ProjectReaderTests-788465148 None] Lock "cinder-quobyte-32122457-2761-4521-980b-4c0b1a23e68d" acquired by "delete_volume" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:26:00 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4175768-f461-43a9-a3b3-90b69d1fccce]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:26:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2f8a53bd-e532-4c33-95f9-09db49675926 tempest-ProjectReaderTests-788465148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-32122457-2761-4521-980b-4c0b1a23e68d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:26:00 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-32122457-2761-4521-980b-4c0b1a23e68d Sep 06 08:26:00 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:26:00 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Sep 06 08:26:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2f8a53bd-e532-4c33-95f9-09db49675926 tempest-ProjectReaderTests-788465148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-32122457-2761-4521-980b-4c0b1a23e68d" returned: 0 in 0.349s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:26:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2f8a53bd-e532-4c33-95f9-09db49675926 tempest-ProjectReaderTests-788465148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-32122457-2761-4521-980b-4c0b1a23e68d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:26:00 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-32122457-2761-4521-980b-4c0b1a23e68d Sep 06 08:26:00 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:26:00 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Sep 06 08:26:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2f8a53bd-e532-4c33-95f9-09db49675926 tempest-ProjectReaderTests-788465148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-32122457-2761-4521-980b-4c0b1a23e68d" returned: 0 in 0.241s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:26:00 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2f8a53bd-e532-4c33-95f9-09db49675926 tempest-ProjectReaderTests-788465148 None] Lock "cinder-quobyte-32122457-2761-4521-980b-4c0b1a23e68d" released by "delete_volume" :: held 0.630s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:26:00 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-2f8a53bd-e532-4c33-95f9-09db49675926 tempest-ProjectReaderTests-788465148 None] Created reservations ['14a506c1-0ef3-44cc-86f2-78d354d8613b', '5e6648cf-fbfd-475d-9123-64d68b2cc80f', '81f0da61-c13e-4e45-a3e8-de3786928d9b', '2622e786-3dfb-4a1b-bba1-69662bcaf57d'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:26:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2f8a53bd-e532-4c33-95f9-09db49675926 tempest-ProjectReaderTests-788465148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:26:00 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2f8a53bd-e532-4c33-95f9-09db49675926 tempest-ProjectReaderTests-788465148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:26:00 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2f8a53bd-e532-4c33-95f9-09db49675926 tempest-ProjectReaderTests-788465148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-2f8a53bd-e532-4c33-95f9-09db49675926 tempest-ProjectReaderTests-788465148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-2f8a53bd-e532-4c33-95f9-09db49675926 tempest-ProjectReaderTests-788465148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2f8a53bd-e532-4c33-95f9-09db49675926 tempest-ProjectReaderTests-788465148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:26:01 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:26:01 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:26:01 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-2f8a53bd-e532-4c33-95f9-09db49675926 tempest-ProjectReaderTests-788465148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.242s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-2f8a53bd-e532-4c33-95f9-09db49675926 tempest-ProjectReaderTests-788465148 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:26:01 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-2f8a53bd-e532-4c33-95f9-09db49675926 tempest-ProjectReaderTests-788465148 None] Deleted volume successfully. Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-2f8a53bd-e532-4c33-95f9-09db49675926 tempest-ProjectReaderTests-788465148 None] Lock "cinder-32122457-2761-4521-980b-4c0b1a23e68d-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Flow 'volume_create_manager' (9ba2e037-6ff8-400d-bad7-32b3cad68b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d552e9f6-3a52-4160-a233-b96d14296de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d552e9f6-3a52-4160-a233-b96d14296de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1664892957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20af46ef-9af4-4e47-b4e4-d8177813833d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03033da31e1f4c92bf4bc0c3857594db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:26:02Z,use_quota=True,user_id='d7600853d7814b27b4389f8434c6f936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d0e5d8-2dd8-45c4-9794-9d2244fbbbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d0e5d8-2dd8-45c4-9794-9d2244fbbbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a777c0-76c4-4877-b9c9-ac460f6d6927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a777c0-76c4-4877-b9c9-ac460f6d6927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20af46ef-9af4-4e47-b4e4-d8177813833d', 'volume_name': 'volume-20af46ef-9af4-4e47-b4e4-d8177813833d', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b9a900-6f27-42ee-9260-762295909dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b9a900-6f27-42ee-9260-762295909dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7945f1cb-6a7d-4798-81d9-baef137db0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:26:01 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Volume 20af46ef-9af4-4e47-b4e4-d8177813833d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20af46ef-9af4-4e47-b4e4-d8177813833d', 'volume_size': 1} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1664892957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20af46ef-9af4-4e47-b4e4-d8177813833d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03033da31e1f4c92bf4bc0c3857594db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:26:02Z,use_quota=True,user_id='d7600853d7814b27b4389f8434c6f936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Creating volume 20af46ef-9af4-4e47-b4e4-d8177813833d {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:26:01 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:26:01 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-20af46ef-9af4-4e47-b4e4-d8177813833d 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:26:01 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-20af46ef-9af4-4e47-b4e4-d8177813833d 1073741824 Sep 06 08:26:01 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:26:02 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Sep 06 08:26:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-20af46ef-9af4-4e47-b4e4-d8177813833d 1073741824" returned: 0 in 0.399s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:26:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-20af46ef-9af4-4e47-b4e4-d8177813833d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:26:02 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-20af46ef-9af4-4e47-b4e4-d8177813833d Sep 06 08:26:02 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:26:02 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Sep 06 08:26:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-20af46ef-9af4-4e47-b4e4-d8177813833d" returned: 0 in 0.243s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:26:02 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:26:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:26:02 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7945f1cb-6a7d-4798-81d9-baef137db0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20af46ef-9af4-4e47-b4e4-d8177813833d', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:26:02 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80aa3f20-ecd5-430f-88db-3e1825cb37d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:26:02 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Volume volume-20af46ef-9af4-4e47-b4e4-d8177813833d (20af46ef-9af4-4e47-b4e4-d8177813833d): created successfully Sep 06 08:26:02 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80aa3f20-ecd5-430f-88db-3e1825cb37d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:26:02 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Flow 'volume_create_manager' (9ba2e037-6ff8-400d-bad7-32b3cad68b3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:26:02 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-3b40f75c-c6b1-40ad-b2b4-68581c8355ef tempest-ProjectReaderTests-788465148 None] Created volume successfully. Sep 06 08:26:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6efc53ac-5392-409f-8f00-feac037fe273 tempest-ProjectReaderTests-788465148 None] Acquiring lock "cinder-20af46ef-9af4-4e47-b4e4-d8177813833d-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:26:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6efc53ac-5392-409f-8f00-feac037fe273 tempest-ProjectReaderTests-788465148 None] Lock "cinder-20af46ef-9af4-4e47-b4e4-d8177813833d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:26:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6efc53ac-5392-409f-8f00-feac037fe273 tempest-ProjectReaderTests-788465148 None] Acquiring lock "cinder-quobyte-20af46ef-9af4-4e47-b4e4-d8177813833d" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:26:02 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6efc53ac-5392-409f-8f00-feac037fe273 tempest-ProjectReaderTests-788465148 None] Lock "cinder-quobyte-20af46ef-9af4-4e47-b4e4-d8177813833d" acquired by "delete_volume" :: waited 0.015s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:26:02 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b52f61a-860b-4b48-8080-56a00f977e49]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:26:02 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6efc53ac-5392-409f-8f00-feac037fe273 tempest-ProjectReaderTests-788465148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-20af46ef-9af4-4e47-b4e4-d8177813833d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:26:03 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-20af46ef-9af4-4e47-b4e4-d8177813833d Sep 06 08:26:03 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:26:03 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Sep 06 08:26:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6efc53ac-5392-409f-8f00-feac037fe273 tempest-ProjectReaderTests-788465148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-20af46ef-9af4-4e47-b4e4-d8177813833d" returned: 0 in 0.357s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:26:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6efc53ac-5392-409f-8f00-feac037fe273 tempest-ProjectReaderTests-788465148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-20af46ef-9af4-4e47-b4e4-d8177813833d {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:26:03 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-20af46ef-9af4-4e47-b4e4-d8177813833d Sep 06 08:26:03 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:26:03 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Sep 06 08:26:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6efc53ac-5392-409f-8f00-feac037fe273 tempest-ProjectReaderTests-788465148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-20af46ef-9af4-4e47-b4e4-d8177813833d" returned: 0 in 0.235s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:26:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6efc53ac-5392-409f-8f00-feac037fe273 tempest-ProjectReaderTests-788465148 None] Lock "cinder-quobyte-20af46ef-9af4-4e47-b4e4-d8177813833d" released by "delete_volume" :: held 0.627s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:26:03 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-6efc53ac-5392-409f-8f00-feac037fe273 tempest-ProjectReaderTests-788465148 None] Created reservations ['052b5c24-c711-491d-9979-c47f662db635', 'd522df5d-7d38-4294-bb75-f1c76eb18e71', 'da8771ef-c740-44fa-85c8-36717e3526b2', '66bcebb8-d15c-47e3-ba14-3c262286345e'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:26:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6efc53ac-5392-409f-8f00-feac037fe273 tempest-ProjectReaderTests-788465148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:26:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6efc53ac-5392-409f-8f00-feac037fe273 tempest-ProjectReaderTests-788465148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:26:03 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6efc53ac-5392-409f-8f00-feac037fe273 tempest-ProjectReaderTests-788465148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:26:03 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-6efc53ac-5392-409f-8f00-feac037fe273 tempest-ProjectReaderTests-788465148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:26:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-6efc53ac-5392-409f-8f00-feac037fe273 tempest-ProjectReaderTests-788465148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:26:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6efc53ac-5392-409f-8f00-feac037fe273 tempest-ProjectReaderTests-788465148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:26:03 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:26:03 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:26:03 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 06 08:26:03 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-6efc53ac-5392-409f-8f00-feac037fe273 tempest-ProjectReaderTests-788465148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.241s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:26:03 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-6efc53ac-5392-409f-8f00-feac037fe273 tempest-ProjectReaderTests-788465148 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:26:03 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-6efc53ac-5392-409f-8f00-feac037fe273 tempest-ProjectReaderTests-788465148 None] Deleted volume successfully. Sep 06 08:26:03 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-6efc53ac-5392-409f-8f00-feac037fe273 tempest-ProjectReaderTests-788465148 None] Lock "cinder-20af46ef-9af4-4e47-b4e4-d8177813833d-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:26:04 devstack cinder-volume[87307]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87307) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 08:26:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Flow 'volume_create_manager' (ffbb11eb-c650-4bc9-bd0e-60c110300b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:26:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea849373-2c2f-466c-9d70-7adecbc91df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:26:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea849373-2c2f-466c-9d70-7adecbc91df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1891614412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad23d2e2-a3a7-4fa8-b531-49cc63646597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03033da31e1f4c92bf4bc0c3857594db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:26:04Z,use_quota=True,user_id='d7600853d7814b27b4389f8434c6f936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:26:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd3c81e-d675-4c4f-b624-77d82a8d1394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:26:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd3c81e-d675-4c4f-b624-77d82a8d1394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:26:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edca15a2-d224-4de0-bf72-b951fab044fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:26:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edca15a2-d224-4de0-bf72-b951fab044fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad23d2e2-a3a7-4fa8-b531-49cc63646597', 'volume_name': 'volume-ad23d2e2-a3a7-4fa8-b531-49cc63646597', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:26:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df865a14-5298-45eb-9f4f-e4472df49ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:26:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df865a14-5298-45eb-9f4f-e4472df49ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:26:04 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f6d200-cd13-46ac-980d-5a3c9041b9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:26:04 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Volume ad23d2e2-a3a7-4fa8-b531-49cc63646597: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad23d2e2-a3a7-4fa8-b531-49cc63646597', 'volume_size': 1} Sep 06 08:26:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:26:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:26:04 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T06:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1891614412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad23d2e2-a3a7-4fa8-b531-49cc63646597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03033da31e1f4c92bf4bc0c3857594db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T06:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T06:26:04Z,use_quota=True,user_id='d7600853d7814b27b4389f8434c6f936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09e95cd-4a3c-48e9-928e-920e48becdff),volume_type_id=d09e95cd-4a3c-48e9-928e-920e48becdff)}" {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 08:26:04 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.remotefs [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Creating volume ad23d2e2-a3a7-4fa8-b531-49cc63646597 {{(pid=87307) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 08:26:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:26:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:26:04 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:26:04 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:26:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:26:04 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Selected osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 as target Quobyte volume. {{(pid=87307) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 06 08:26:04 devstack cinder-volume[87307]: INFO cinder.volume.drivers.remotefs [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] casted to osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0 Sep 06 08:26:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad23d2e2-a3a7-4fa8-b531-49cc63646597 1073741824 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:26:04 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad23d2e2-a3a7-4fa8-b531-49cc63646597 1073741824 Sep 06 08:26:04 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:26:04 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Sep 06 08:26:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad23d2e2-a3a7-4fa8-b531-49cc63646597 1073741824" returned: 0 in 0.396s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:26:04 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad23d2e2-a3a7-4fa8-b531-49cc63646597 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:26:04 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad23d2e2-a3a7-4fa8-b531-49cc63646597 Sep 06 08:26:04 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:26:05 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Sep 06 08:26:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad23d2e2-a3a7-4fa8-b531-49cc63646597" returned: 0 in 0.242s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:26:05 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'} {{(pid=87307) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 08:26:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:26:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f6d200-cd13-46ac-980d-5a3c9041b9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad23d2e2-a3a7-4fa8-b531-49cc63646597', 'volume_size': 1}' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:26:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed9af61-b5f2-4e5e-8a78-899cc9faae8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 08:26:05 devstack cinder-volume[87307]: INFO cinder.volume.flows.manager.create_volume [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Volume volume-ad23d2e2-a3a7-4fa8-b531-49cc63646597 (ad23d2e2-a3a7-4fa8-b531-49cc63646597): created successfully Sep 06 08:26:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed9af61-b5f2-4e5e-8a78-899cc9faae8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87307) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 08:26:05 devstack cinder-volume[87307]: DEBUG cinder.volume.manager [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Flow 'volume_create_manager' (ffbb11eb-c650-4bc9-bd0e-60c110300b6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87307) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 08:26:05 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-8e4ca6f9-848b-4090-a6f3-63c09d9e8c37 tempest-ProjectReaderTests-788465148 None] Created volume successfully. Sep 06 08:26:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-087b7fba-d2dd-4448-b92e-09994513ae96 tempest-ProjectReaderTests-788465148 None] Acquiring lock "cinder-ad23d2e2-a3a7-4fa8-b531-49cc63646597-delete_volume" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:26:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-087b7fba-d2dd-4448-b92e-09994513ae96 tempest-ProjectReaderTests-788465148 None] Lock "cinder-ad23d2e2-a3a7-4fa8-b531-49cc63646597-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:26:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-087b7fba-d2dd-4448-b92e-09994513ae96 tempest-ProjectReaderTests-788465148 None] Acquiring lock "cinder-quobyte-ad23d2e2-a3a7-4fa8-b531-49cc63646597" by "delete_volume" {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 08:26:05 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-087b7fba-d2dd-4448-b92e-09994513ae96 tempest-ProjectReaderTests-788465148 None] Lock "cinder-quobyte-ad23d2e2-a3a7-4fa8-b531-49cc63646597" acquired by "delete_volume" :: waited 0.014s {{(pid=87307) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 08:26:05 devstack cinder-volume[87307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fca1a0-855b-45bc-9f6f-2a768d7d7865]: (4, 'qcow2') {{(pid=88921) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 08:26:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-087b7fba-d2dd-4448-b92e-09994513ae96 tempest-ProjectReaderTests-788465148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad23d2e2-a3a7-4fa8-b531-49cc63646597 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:26:05 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad23d2e2-a3a7-4fa8-b531-49cc63646597 Sep 06 08:26:05 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:26:05 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Sep 06 08:26:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-087b7fba-d2dd-4448-b92e-09994513ae96 tempest-ProjectReaderTests-788465148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad23d2e2-a3a7-4fa8-b531-49cc63646597" returned: 0 in 0.346s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:26:05 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-087b7fba-d2dd-4448-b92e-09994513ae96 tempest-ProjectReaderTests-788465148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad23d2e2-a3a7-4fa8-b531-49cc63646597 {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:26:05 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad23d2e2-a3a7-4fa8-b531-49cc63646597 Sep 06 08:26:05 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:26:06 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 06 08:26:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-087b7fba-d2dd-4448-b92e-09994513ae96 tempest-ProjectReaderTests-788465148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee/volume-ad23d2e2-a3a7-4fa8-b531-49cc63646597" returned: 0 in 0.249s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:26:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-087b7fba-d2dd-4448-b92e-09994513ae96 tempest-ProjectReaderTests-788465148 None] Lock "cinder-quobyte-ad23d2e2-a3a7-4fa8-b531-49cc63646597" released by "delete_volume" :: held 0.631s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:26:06 devstack cinder-volume[87307]: DEBUG cinder.quota [None req-087b7fba-d2dd-4448-b92e-09994513ae96 tempest-ProjectReaderTests-788465148 None] Created reservations ['7470f3a1-82f1-439f-98f5-0d4a7375f5bc', '9f1242bc-b668-455c-85fb-10925631d048', '4fdcc1bc-c40b-4f63-a141-31d114a759d7', 'b4fea5c6-34f5-42f6-8cc6-e804939782d7'] {{(pid=87307) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 08:26:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-087b7fba-d2dd-4448-b92e-09994513ae96 tempest-ProjectReaderTests-788465148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 08:26:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-087b7fba-d2dd-4448-b92e-09994513ae96 tempest-ProjectReaderTests-788465148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 08:26:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-087b7fba-d2dd-4448-b92e-09994513ae96 tempest-ProjectReaderTests-788465148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0': None} {{(pid=87307) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 06 08:26:06 devstack cinder-volume[87307]: DEBUG cinder.volume.drivers.quobyte [None req-087b7fba-d2dd-4448-b92e-09994513ae96 tempest-ProjectReaderTests-788465148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb1a3a98-cab8-444d-865b-8b769af18cd0'] {{(pid=87307) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 06 08:26:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.lockutils [None req-087b7fba-d2dd-4448-b92e-09994513ae96 tempest-ProjectReaderTests-788465148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87307) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 08:26:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-087b7fba-d2dd-4448-b92e-09994513ae96 tempest-ProjectReaderTests-788465148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 08:26:06 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee Sep 06 08:26:06 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 08:26:06 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Sep 06 08:26:06 devstack cinder-volume[87307]: DEBUG oslo_concurrency.processutils [None req-087b7fba-d2dd-4448-b92e-09994513ae96 tempest-ProjectReaderTests-788465148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/66056445333a2336b2f2e33925cedfee" returned: 0 in 0.245s {{(pid=87307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 08:26:06 devstack cinder-volume[87307]: DEBUG cinder.manager [None req-087b7fba-d2dd-4448-b92e-09994513ae96 tempest-ProjectReaderTests-788465148 None] Notifying Schedulers of capabilities ... {{(pid=87307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 08:26:06 devstack cinder-volume[87307]: INFO cinder.volume.manager [None req-087b7fba-d2dd-4448-b92e-09994513ae96 tempest-ProjectReaderTests-788465148 None] Deleted volume successfully. Sep 06 08:26:06 devstack cinder-volume[87307]: DEBUG cinder.coordination [None req-087b7fba-d2dd-4448-b92e-09994513ae96 tempest-ProjectReaderTests-788465148 None] Lock "cinder-ad23d2e2-a3a7-4fa8-b531-49cc63646597-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87307) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 08:26:16 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:UPDATE=40,cinder:SELECT=33,cinder:INSERT=8,cinder:DELETE=4 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 08:26:16 devstack cinder-volume[87307]: DEBUG dbcounter [-] [87307] Writing DB stats cinder:SELECT=24,cinder:UPDATE=49,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}